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Abstract 



The purpose of this thesis is to give a formal definition of quantum Kol- 
mogorov complexity and rigorous mathematical proofs of its basic proper- 
ties. 

Classical Kolmogorov complexity is a well-known and useful measure of 
randomness for binary strings. In recent years, several different quantum 
generalizations of Kolmogorov complexity have been proposed. The most 
natural generalization is due to Berthiaume et al. [5j, defining the complexity 
of a quantum bit (qubit) string as the length of the shortest quantum input 
for a universal quantum computer that outputs the desired string. Except for 
slight modifications, it is this definition of quantum Kolmogorov complexity 
that we study in this thesis. 

We start by analyzing certain aspects of the underlying quantum Tur- 
ing machine (QTM) model in a more detailed formal rigour than was done 
previously. Afterwards, we apply these results to quantum Kolmogorov com- 
plexity. 

Our first result, based on work by Bernstein and Vazirani [4J, is a proof 
of the existence of a universal QTM which simulates every other QTM for 
an arbitrary number of time steps and than halts with probability one. In 
addition, we show that every input that makes a QTM almost halt can be 
modified to make the universal QTM halt entirely, by adding at most a 
constant number of qubits. 

It follows that quantum Kolmogorov complexity has the invariance prop- 
erty, i.e. it depends on the choice of the universal QTM only up to an additive 
constant. Moreover, the quantum complexity of classical strings agrees with 
classical complexity, again up to an additive constant. The proofs are based 
on several analytic estimates. 

Furthermore, we prove several incompressibility theorems for quantum 
Kolmogorov complexity. Finally, we show that for ergodic quantum infor- 
mation sources, complexity rate and entropy rate coincide with probability 
one. 

The thesis is finished with an outlook on a possible application of quan- 
tum Kolmogorov complexity in statistical mechanics. 
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IV Abstract 



Zusammenfassung 



Ziel dieser Arbeit ist es, den Begriff der Quanten-Kolmogorov-Komplexitat 
formal zu definieren und seine wichtigsten Eigenschaften rigoros zu beweisen. 

Die klassische Kolmogorov-Komplexitat ist ein bekanntes und niitzliches 
MaB fiir die Zufalligkeit endlicher Worter. In den letzten Jahren wurden 
unterschiedliche Quantenverallgemeinerungen der Kolmogorov-Komplexitat 
vorgeschlagen. Die natiirlichste Art der Verallgemeinerung stammt von 
Berthiaume u.a. [5], die die Komplexitat eines Quantenwortes definieren als 
die Lange der kiirzesten Quanteneingabe fiir einen universellen Quantencom- 
puter, die als Ausgabe das entsprechende Wort produziert. Abgesehen von 
kleinen Anderungen soil dieser Komplexitatsbegriff in der hier vorliegenden 
Arbeit untersucht werden. 

Zunaclist untersuchen wir verschiedene Aspekte des zugrunde liegenden 
Modells der Quantenturingmaschine (QTM), und zwar mit groBerer formaler 
Genauigkeit als in bisherigen Arbeiten. AnschlieBend wenden wir diese Re- 
sultate auf die Quanten-Kolmogorov-Komplexitat an. 

Unser erstes Ergebnis, basierend auf der Arbeit von Bernstein und Vazi- 
rani [5], ist ein Beweis fiir die Existenz einer universellen QTM, die jede 
andere QTM fiir eine beliebige Anzahl von Zeitschritten simulieren kann, 
und dann selbst mit Wahrscheinlichkeit eins halt. Welter bin zeigen wir, dass 
jede Eingabe, die eine QTM beinahe halten lasst, modifiziert werden kann, 
um eine Eingabe zu erhalten, die die universelle QTM vollstandig halten 
lasst, wobei sich die Eingabelange hochstens um eine konstante Anzahl von 
Qubits vergrofiert. 

Daraus folgt, dass die Quanten-Kolmogorov-Komplexitat die Invari- 
anzeigenschaft besitzt, d.h. sie ist bis auf eine additive Konstante un- 
abhangig von der Wahl der universellen QTM. AuBerdem stimmt die 
Quantenkomplexitat klassischer Worter mit deren klassischer Komplexitat 
iiberein, wieder bis auf eine additive Konstante. Die entsprechenden Beweise 
beruhen auf verschiedenen analytischen Abschatzungen. 

Weiterhin beweisen wir mehrere Satze, die zeigen, dass nur wenige Quan- 
tenworter kleine Quantenkomplexitat besitzen konnen. Schliefilich zeigen 
wir, dass bei ergodischen Quantendatenquellen Komplexitatsrate und En- 
tropierate mit Wahrscheinlichkeit eins iibereinstimmen. 

Den Abschluss der Arbeit bildet ein Ausblick auf eine mogliche Anwen- 
dung der Quanten-Kolmogorov-Komplexitat in der statistischen Mechanik. 
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Chapter 1 

Introduction 



Kolmogorov complexity is an important measure of the information content 
of single binary strings. It is motivated by the fact that regular objects tend 
to have short descriptions. Consider for example two binary strings s and t, 
both consisting of a million bits, namely 

s = 101010101010101010101010 . . . , t = 1101011101000000010110101 . . . 

The string s is purely repetitive, while the string t looks quite irregular; in 
fact, it has been recorded during a physics experiment with some radioactive 
source. 

So why does t look more irregular than s? We can easily describe s 
by saying that s consists of 500.000 repetitions of 10, while we need a lot 
more words and effort to specify the exact value of t. Thus, it makes sense 
to measure the irregularity or randomness of a binary string as the length 
of its shortest description. To avoid problems, we have to beware of self- 
contradictory descriptions like the following: 

"Let n he the smallest integer that cannot he descrihed in less than a 

hundred words. " 

This statement is the well-known Berry Paradox, cf . [23] . So we should only 
accept descriptions that are explicit enough to give instructions for con- 
structing the corresponding string unambiguously and purely mechanically. 
This requirement is definitely fulfilled by computer programs that make a 
predefined computer halt and output some string in a finite amount of time. 
So we choose some universal computer U and measure the irregularity, or 
Kolmogorov complexity C, of some binary string s as the length i of the 
shortest program that makes the universal computer output s: 

C{s) := mm{£{p) \ U{p) = s]. 

For regular strings like s (even if they have some large length n) , we can find 
short computer programs like "print n times the string 10 while for strings 
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like t, there seems to be no obvious way to compress the binary digits into 
a short computer program (although there might be one which we do not 
know). To encode some integer n, we need about log n bits, where log = log2 
here and in the remainder of the thesis denotes the binary logarithm. Thus, 

. . 1 ) < log n + 0(1), while C( 10110100 ... 1 ) « n. 
^ n random bits 

The mathematical theory of Kolmogorov complexity and some related 
notions like algorithmic probability is called algorithmic information theory. 
It has been developed since the 1960's by Kolmogorov ^21J, Solomonoff |41j . 
Chaitin [TO], and others, and is still a lively field of research. 

In recent years, there has been extensive study on how the extraordinary 
world of quantum mechanics changes the way that information can be trans- 
mitted, stored and processed in our universe. In this field of research, called 
quantum information theory, many aspects of classical information theory 
have already been extended and generalized to the quantum situation. It is 
thus natural to ask whether also some quantum counterpart of Kolmogorov 
complexity can be found. It is tempting to try so for several reasons: 

• Kolmogorov complexity has applications in many areas, including clas- 
sical computer science, information theory and statistical mechanics. 
Thus, one may hope that its quantum counterpart is similarly use- 
ful in areas like quantum information theory or quantum statistical 
mechanics. 

• Quantum Kolmogorov complexity promises to unite two different kinds 
of randomness in a single theory: quantum randomness, originating 
from measurements in quantum theory, and algorithmic randomness, 
corresponding to incompressibility. 

• Every quantum system in our universe that behaves according to some 
computable time evolution is a quantum computer, in the sense that 
it can in principle be simulated by a quantum Turing machine. By def- 
inition, the corresponding computation cannot change the complexity 
of the system's state too much. In this case, quantum Kolmogorov 
complexity might turn out to be a useful invariant. 

In the next section, we briefly describe previous work on quantum Kol- 
mogorov complexity, while in Section [1.2^ we describe what is done in this 
thesis, why it is done, and in what way. 
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1.1 Previous Work on Quantum Kolmogorov 
Complexity 

While classical information theory deals with finite binary string^ 

{0, 1}* = {A, 0, 1, 00, 01, 10, 11, 000, 001, . . .}, 

quantum information theory allows arbitrary superpositions of classical 
strings like 

IV) = -^(1001) + 1110)). 

The idea of quantum Kolmogorov complexity is to assign some complexity 
measure C{\'4))) to every such quantum state IV'), namely the length of the 
shortest program for a universal quantum computer to produce the state 

IV-). 

Yet, in contrast to the classical situation, it is not clear at the outset 
what the details of such a definition should look like. What, for example, is 
exactly meant by "universal quantum computer"? Then, what is a proper 
"program" or "input" for a quantum computer - is it a classical bit string, 
or some quantum state itself? In the second case, what is the "length" of 
such a quantum state? Moreover, do we demand that the quantum computer 
produces the state exactly, or do we allow some error tolerance in the 
continuum of quantum states? 

In recent years, there have been several attempts to define and study 
quantum Kolmogorov complexity. Most of them seem to be inequivalent, 
reflecting the different possibilities mentioned above. In the remainder of 
this section, we will briefly discuss some of them. The definition which is 
used in this thesis can be found in Section [3.11 

The first definition of quantum Kolmogorov complexity is due to 
Svozil [33]. He defines the algorithmic complexity H oi a vector s G 
in some Hilbert space ^ as the length of the shortest classical program p for 
a universal quantum computer C to output that element, 

H[s) := min ^(p). 

C{p)=s 

Since there are countably many classical binary strings, but uncountably 
many quantum states, this definition has the disadvantage that it is unde- 
fined (or infinite) for many states s ^ 9). 

Later, a similar definition was given by Vitanyi [l5]. He also allows only 
classical inputs, but circumvents the aforementioned problem by allowing 
some error and introducing some penalty term for non-perfect output. His 
definition reads 

K{\x)) = min{£(p) + r-log|Kz|x)|p] : Q{p) = |z)}, 
^Note that A denotes the empty string of length zero. 
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where Q is some universal quantum Turing machine. In this case, the output 
Q{p) of the machine Q on input p does not have to be exactly equal to |x), 
but can differ by a small amount. Nevertheless, if Q{p) and the desired state 
\x) differ too much, then the penalty term [— log gets large, and 

the minimum is attained at another argument, not at p. 

Mora and Briegel [26^ [27] define the quantum Kolmogorov complexity of 
some quantum state as the length of the shortest classical description of some 
quantum circuit that prepares that state. Maybe this approach is related to 
the ones mentioned before. In any case, it seems to have the advantage to 
be more utilizable for applications than other definitions of complexity. 

The first purely quantum definition has been given by Berthiaume, van 
Dam, and Laplante [5]. They explicitly allow inputs that are themselves 
quantum, i.e. superpositions of classical strings of some common length. 
They define 

QC^{m=min{l{W)) I {i,\U{\ip)m>a}, 

that is, the complexity of is the length of the shortest quantum input 
\(p) that produces IV') with some fidelity which is larger than a. Thus, for 
a = 1, U{\(p)) must be equal to 1-0), while for a < 1, some inaccuracy in 
the output of the universal quantum computer U is allowed. Moreover, they 
define a similar notion of complexity by means of an approximation scheme, 
which will be described later on in Section 13.11 

We argue that this kind of definition is in some sense the most natural 
quantum extension of Kolmogorov complexity, since inputs and outputs are 
treated symmetrically. In a quantum world, quantum computers can have 
quantum inputs. Our definition in Section [3.11 is thus very similar; we basi- 
cally use the definition by Berthiaume et al., except for slight modifications 
(e.g. we also allow superpositions of strings of different lengths). 

We give some evidence why this kind of definition is natural in Sec- 
tion 13.51 where we prove an intimate connection between von Neumann 
entropy and this kind of complexity, which seems to be impossible for all 
definitions of quantum complexity that are restricted to classical inputs. 

A quite different idea of how to define quantum Kolmogorov complexity 
has been elaborated by Gacs [H]. His approach is motivated by Levin's cod- 
ing theorem from classical Kolmogorov complexity. Levin's coding theorem is 
about so-called semimeasures, i.e. "probability distributions" p on the strings 
such that the sum X]xe{o i}* P(^) ^^^^ than one. A semimeasure is 

called semicomputable if there is a monotonically increasing, computable se- 
quence of functions converging to it. There is a theorem stating that there 
exists a so-called universal semicomputable semimeasure /i, where universal 
means that > i^ix) ■ Cy for every other semicomputable semimeasure v, 
and Cjy is a constant not depending on x. 

Levin's coding theorem says that the Kolmogorov complexity of some 
string X equals — log/i(x) within some additive constant. Contrariwise, this 
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means that Kolmogorov complexity can also be defined as the negative log- 
arithm of some universal semicomputable semimeasure without reference to 
program lengths. 

Consequently, Gacs showed the existence of a universal semicomputable 
semi-density matrix, and then defined its logarithm as the quantum Kol- 
mogorov complexity of some quantum state. It is not clear how this approach 
is related to the other definitions, although he shows some interesting es- 
timations among the different definitions in his paper. Moreover, the fact 
that his definition works without reference to any model of a quantum com- 
puter is a striking feature, but may also make it different to relate his notion 
to concrete program lengths in quantum computation. A similar and more 
general idea has been elaborated by Tadaki [33], but for different purpose. 

It is an open problem whether all these definitions are unrelated or some 
of them are equivalent. The aim of this thesis is not to solve this problem, but 
rather to give a rigorous analysis of the definition given by Berthiaume et al. 
[5], although some of the results on this thesis might in the end contribute 
to the classification of the different complexity notions. 

1.2 Synopsis and Main Results 

In this section, we describe how this thesis is organized. This thesis consists 
of two parts. The first part is about quantum Turing machines, the second 
part is about quantum Kolmogorov complexity. 

As the purpose of this thesis is to develop the basics of quantum Kol- 
mogorov complexity in full mathematical rigour, it is necessary to study in 
detail the underlying model of quantum computation, which is the quantum 
Turing machine (QTM). There is nothing special about the QTM model; 
other models of quantum computation like the circuit model (cf. [30j) or 
measurement-based quantum computers [36] are equivalent in their com- 
putational power (see, for example, [31]). We chose this model as there is 
a large volume of existing literature discussing various aspects of QTMs. 
Also, the model seems interesting in itself, as it is a direct quantization of 
the popular model of classical computation, the Turing machine (TM). 

It will be shown in Chapter [3] that many important properties of quan- 
tum Kolmogorov complexity, like the invariance property, are sensitive to 
the details of quantum computation itself. Most of the previous work studied 
QTMs with the purpose to analyze computational complexity, i.e. to answer 
questions like how efficient (fast) quantum algorithms can be, and how effi- 
ciently different quantum computers can simulate each other. As quantum 
Kolmogorov complexity is insensitive to execution times of algorithms, but 
instead studies the program lengths, different aspects of quantum compu- 
tation become important. In more detail, in Chapter |2l we proceed in the 
following way: 
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• In Section r2.lt we start by defining the notion of a qubit string and give 
two different ways to quantify its length. Then, we give a mathematical 
framework for QTMs, based on the work by Bernstein and Vazirani 
[1]; we define a QTM as a special kind of partial map on the qubit 
strings. 

• In Section [2. 2t we discuss the problem of defining when a QTM halts. 
We argue that the most natural and useful definition of halting, at 
least in the context of quantum Kolmogorov complexity, is to demand 
perfect halting and to dismiss any input which brings the QTM into 
some superposition or mixture of halting and non-halting. 

Moreover, we discuss the notion of universality of a QTM. We show 
that the previous definition of a universal QTM by Bernstein and 
Vazirani is perfectly suitable for the study of computational complex- 
ity, but is not sufficient for studying quantum Kolmogorov complexity. 
This is due to the restriction that in the previous approach, the halting 
time has to be specified in advance. 

• Consequently, in Section \2.'6\ we give a full proof that there exists a 
universal QTM which simulates every other QTM without knowing 
the halting time in advance, and then halts perfectly. This result is 
necessary to show in Chapter [3] that quantum Kolmogorov complexity 
depends on the choice of the universal QTM only up to an additive 
constant. 

The construction of this "strongly universal" QTM is based on the 
observation that the valid inputs are organized in mutually orthogo- 
nal halting spaces. Moreover, these halting spaces can be computably 
approximated. We define these approximate halting spaces and show 
several properties, based on analytic estimates. 

Some slightly different universality results are needed for the differ- 
ent notions of quantum Kolmogorov complexity (e.g. with or without 
a second parameter) that we study in Chapter [3l Thus, we also de- 
scribe how the proof can be modified to obtain the various different 
universality results. 

• In Section 12.41 we show a stability result for the halting scheme of 
QTMs: every input which makes a QTM almost halt can be modified to 
make the QTM halt perfectly, by adding at most a constant number of 
qubits. This shows that the halting scheme defined before in Section [^TT] 
is not "unphysical" , since it has some inherent error tolerance that 
was not expected from the beginning. It also means that we can to 
some extent use quantum programs with probabilistic behaviour for 
estimates of quantum Kolmogorov complexity. 
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In Chapter [3l we then turn to the study of quantum Kolmogorov com- 
plexity. 

• In Section 13.11 we give four different definitions of quantum Kol- 
mogorov complexity (QC, QC\ QK and QK ). They differ on the 
one hand by the way we quantify the length of qubit strings (base 
length i or average length £), and on the other hand by the way we 
allow some error in the QTM's output. Yet, they are similar enough to 
be studied all at the same time. Most of the time, we will nevertheless 
restrict our analysis to the complexities QC and QC^ ■, since they are 
in some sense easier to handle than QK and QK . 

• In Section 13.21 we prove some "quantum counting argument" , which 
allows to derive an upper bound on the number of mutually orthogonal 
vectors that are reproduced by quantum operations within some fixed 
error tolerance. Furthermore, we prove two incompressibility theorems 
for quantum Kolmogorov complexity. 

• We show that quantum Kolmogorov complexity is invariant in Sec- 
tion 13. 3i This means that it depends on the choice of the universal 
QTM only up to an additive constant. In the classical case, the invari- 
ance theorem is the cornerstone for the whole theory of Kolmogorov 
complexity, and in the quantum case, we expect that it will be of 
similar importance. 

• The aim of defining a quantum Kolmogorov complexity is to find a gen- 
eralization of classical Kolmogorov complexity to quantum systems. In 
Section [3^ we show that this point of view is justified by proving that 
both complexities closely coincide on the domain of classical strings. 
That is, the quantum complexity QC of classical strings equals the 
classical complexity C up to some constant. For the quantum com- 
plexity QC^ with some fixed error tolerance 5 for the QTM's output, 
we prove that both are equal up to some factor 1/(1 — 45). 

• In Section 13.51 we prove that the von Neumann entropy rate of an 
ergodic quantum information source is arbitrarily close to its Kol- 
mogorov complexity rate with probability one. This generalizes a 
classical theorem which has first been conjectured by Zvonkin and 
Levin [38] and was later proved by Brudno [9]. 

The case that is typically studied in quantum information theory is 
an i.i.d. source, that is, many copies of a single density operator p. 
Ergodic sources generalize this model to the case where the source is 
still stationary, but the different instances can be correlated in com- 
plicated ways. The quantum Brudno's theorem shows that for such 
sources, the randomness (quantum Kolmogorov complexity) of single 
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strings emitted by the source typically equals the randomness of the 
source itself (its von Neumann entropy). 

This part of the thesis is joint work with F. Benatti, T. Kriiger, Ra. 
Siegmund-Schultze, and A. Szkola. 

Finally, in a summary and outlook, we discuss perspectives for further 
research and propose a concrete application of quantum Kolmogorov com- 
plexity in quantum statistical mechanics. 



Chapter 2 

The Quantum Turing 
Machine 

The previous work on quantum Turing machines (QTMs) focused on com- 
putational complexity, i.e. on questions hke how efficient QTMs can perform 
certain tasks or simulate other quantum computing machines. Since quan- 
tum Kolmogorov complexity does not depend on the time of computation, 
but only focuses on the length of the input, we have to explore different 
aspects of QTMs which have not been analyzed in this way before. 

Note that the results on QTMs that we prove in this chapter may also 
be valid for other quantum computing devices, as long as they map input 
quantum states to output quantum states, and may or may not halt at some 
time step. 

2.1 Definition of Quantum Turing Machines 

In 1985, Deutsch [12j proposed the first model of a quantum Turing machine 
(QTM), elaborating on an even earlier idea by Feynman [13]. Bernstein and 
Vazirani [3] worked out the theory in more detail and proved that there 
exists an efficient universal QTM (it will be discussed in Section 12.21 in 
what sense). A more compact presentation of these results can be found 
in the book by Gruska [15]. Ozawa and Nishimura [3l] gave necessary and 
sufficient conditions that a QTM's transition function results in unitary time 
evolution. Benioff p] has worked out a slightly different definition which is 
based on a local Hamiltonian instead of a local transition amplitude. 

The definition of QTMs that we use in this thesis will be completely 
equivalent to that by Bernstein and Vazirani. Yet, we will use some different 
kind of notation which makes it easier (or at least more clear) to derive ana- 
lytic estimates like "/low much does the state of the control change at most, 
if the input changes by some amount?\ Also, we use the word QTM not 
only for the model itself, but also for the partial function which it generates. 
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The Quantum Turing Machine 



We start by defining the quantum analogue of a bit string. 
2.1.1 Indeterminate-Length Qubit Strings 

The quantum analogue of a bit string, a so-called qubit string, is a superpo- 
sition of several classical bit strings. To be as general as possible, we would 
like to allow also superpositions of strings of different lengths like 

\^) :=-L(|00) + 111011)). 

Such quantum states are called indeterminate-length qubit strings. They have 
been studied by Schumacher and Westmoreland [39j . as well as by Bostrom 
and Felbinger [8j in the context of lossless quantum data compression. 

Let Tik ■■= (C^°'^^)®^ be the Hilbert space of k qubits {k G No). We write 
C{0'i} for to indicate that we fix two orthonormal computational basis 
vectors |0) and |1). The Hilbert space "^{0,1}* which contains indeterminate- 
length qubit strings like \^) can be formally defined as the direct sum 

00 

^{0,1}* •= ® ^fc- 

fc=0 

The classical finite binary strings {0, 1}* are identified with the computa- 
tional basis vectors in ^{0,1}*, i-e. Wjo,!}* — £^({A, 0, 1, 00, 01, . . .}), where 
A denotes the empty string. We also use the notation 

n 

'H<n ■= ^ Wfc 
fc=0 

and treat it as a subspace of Wjo.i}*- 

To be as general as possible, we do not only allow superpositions of 
strings of different lengths, but also mixtures, i.e. our qubit strings are arbi- 
trary density operators on Wjo^i}*- It will become clear in the next sections 
that QTMs naturally produce mixed qubit strings as outputs. Moreover, 
it will be a useful feature that the result of applying the partial trace to 
segments of qubit strings will itself be a qubit string. 

Furthermore, we would like to say what the length of a qubit string is. 
It was already noticed in [39j and [8] that there are two different natural 
possibilities, which we will give in the next definition. 

Before we state the definition of a qubit string, we fix some notation: if 
?Y is a Hilbert space, than we denote by T{TC) the trace-class operators on 
H. Moreover, Tj^{Tl) shall denote the density operators on Tl, that is, the 
positive trace-class operators with trace 1. 
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Definition 2.1.1 (Qubit Strings and their Length) 

An (indeterminate-length) qubit string a is a density operator on Hjo,!}*- 
Normalized vectors {tp) £ W|o,i}* will also be called qubit strings, identifying 
them with the corresponding density operator \ip){ip\. 

The base length (or just lengthj of a qubit string a G T^^ {Ti^Q^iy*) is 
defined as 

£{a) := max{^(s) | {s\a\s) > 0, s £ {0, 1}*} 

or as i{a) = oo if the maximum does not exist. Moreover, we define the 
average length I{a) G R,| U {cxd} as 

I{a) := TT{aA), 

where A is the unbounded self-adjoint length operator. It is defined as 

oo 
n=0 

on its obvious domain of definition, where Pn denotes the projector onto the 
subspace Tin ofTi^Q iy*. 

For example, the qubit string |^) := (|0) + |1101)) has length = 
4, i.e. the length of an indeterminate-length qubit string equals the maxi- 
mal length of any computational basis vector that has non-zero coefficient 
in the superposition. This is motivated by the fact that a qubit string a 
needs at least £{a) cells on a QTM's tape to be stored perfectly (compare 
Subsection ETS]). 

On the other hand, we have £{\ip)) = ^1 + ^4 = |. Using either i or £ 
will give two different definitions of quantum Kolmogorov complexity. The 
idea to use i in that definition has first been proposed by Rogers and Vedral 

m- 

In contrast to classical bit strings, there are uncountably many qubit 
strings that cannot be perfectly distinguished by means of any quantum mea- 
surement. A good measure for the difference between two quantum states is 
the trace distance (cf. [3Dj) 

ll/o - o-||Tr := ^Tr - (t| . (2.1) 

It has the nice operational meaning to be the maximum difference in prob- 
ability for a yes- no- measurement if either applied to p or cr, cf. [30j . 

This distance measure on the qubit strings will be used in our definition 
of quantum Kolmogorov complexity in Section 13.11 
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2.1.2 Mathematical Framework for QTMs 

To understand the notion of a quantum Turing machine (QTM), we first 
explain how a classical Turing machine (TM) is defined. 

We can think of a classical TM as consisting of three different parts: 
a control C, a head H, and a tape T. The tape consists of cells that are 
indexed by the integers, and carry some symbol from a finite alphabet E. In 
the simplest case, the alphabet consists of a zero, a one, and a special blank 
symbol At the beginning of the computation, all the cells are blank, i.e. 
carry the special symbol ^, except for those cells that contain the input bit 
string. 

The head points to one of the cells. It is connected to the control, which 
in every step of the computation is in one "internal state" q out of a finite 
set Q. At the beginning of the computation, it is in the initial state S Q, 
while the end of the computation (i.e. the halting of the TM) is attained if 
the control is in the so-called final state qf € Q. 

The computation itself, i.e. the TM's time evolution, is determined by a 
so-called transition function 5: depending on the current state of the control 
q €z Q and the symbol a £ T, which is on the tape cell where the head is 
pointing to, the TM turns into some new internal state q' £ Q, writes some 
symbol o"' G S onto this tape cell, and then either turns left (L) or right 
(R). Thus, the transition function 5 is a map 

5 : Q X S ^ Q X S X 

As an example, we consider a TM with alphabet S = {0,1, 7^}, internal 
states Q = {qo,qi,qf} and transition function 5, given by 

qo,0 ^^ qi,l,R 

qo,l ^ qi,0,R 

qi,0 ^^ qi,l,R 

qi,l 1-^ qi,0,R 

qi,# ^ qf,#,R- 

We have not defined 5{qQ,#) and 5{qf,a) for any a; we can define 5 at these 
arguments in an arbitrary way. We imagine that this TM is started with 
some input bit string s, which is written onto the tape segment [0, l{s) — 1]. 
The head initially points to cell number zero. The computation of the TM 
will then invert the string and halt. As an example, in Figure [27L\ we have 
depicted the first steps of the TM's time evolution on input s = 10. 

A QTM is now defined analogously as a TM, but with the important 
difference that the transition function is replaced by a transition amplitude. 
That is, instead of having a single classical successor state for every internal 
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Figure 2.1: Time evolution of a Turing machine 



state and symbol on the tape, a QTM can evolve into a superposition of 
different classical successor states. 

For example, we may have a QTM that, if the control's internal state is 
qo £ Q and the tape symbol is a 0, may turn into internal state qi and write 
a one and turn right, as well as writing a zero and turning left, both at the 
same time in superposition, say with complex amplitudes and 

^0 qo 




-10 12 
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Figure 2.2: One step of time evolution of a quantum Turing machine 



A symbolic picture of this behaviour is depicted in Figure 12.21 This can 
be written as 

qo,0^ {qi,l,R),{qi,0,L) . 

1 -i 

Formally, the transition amplitude 6 is thus a mapping from Q x S to the 
complex functions on Q x S x {L, R}. If the QTM as a whole is described by 
a Hilbert space Hqtm, then we can linearly extend 5 to define some global 
time evolution on TLqtm- We have to take care of two things: 

• According to the postulates of quantum mechanics, we have to con- 
struct 5 in such a way that the resulting global time evolution on 
T~(-QTM is unitary. 

• The complex amplitudes which are assigned to the successor states 
have to be efficiently computable, which has the physical interpreta- 
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tion that we should be able to efficiently prepare hardware (e.g. some 
quantum gate) which realizes the transitions specified by 6. 

Moreover, this requirement also guarantees that every QTM has a 
finite classical description, that there is a universal QTM (see discus- 
sion below), and that we cannot "hide" information (like the answer 
to infinitely many instances of the halting problem) in the transition 
amplitudes. 

Consequently, Bernstein and Vazirani ([3], Def. 3.2.2) define a quantum 
Turing machine M as a triplet {T,,Q,6), where S is a finite alphabet with 
an identified blank symbol Q is a finite set of states with an identified 
initial state qq and final state qf ^ qq, and 5 : Q x S — > ^Q>^'^x{L,R} 
the so-called the quantum transition function, determining the QTM's time 
evolution in a way which is explained below. 

Here, the symbol C denotes the set of complex numbers that are effi- 
ciently computable. In more detail, a E C if and only if there is a determin- 
istic algorithm that computes the real and imaginary parts of a to within 
2~" in time polynomial in n. 

Every QTM evolves in discrete, integer time steps, where at every step, 
only a finite number of tape cells is non-blank. For every QTM, there is a 
corresponding Hilbert space 

'Hqtm = T~Cc ® Ti-T ® Ti-n, 

where He = is a finite-dimensional Hilbert space spanned by the (or- 
thonormal) control states q G Q, while TCt = i'^{T) and Tin = £^(Z) are 
separable Hilbert spaces describing the contents of the tape and the position 
of the head. In this definition, the symbol T denotes the set of classical tape 
configurations with finitely many non-blank symbols, i.e. 

T = { {x,)iez G I X, / # for finitely many i G z} . (2.2) 

For our purpose, it is useful to consider a special class of QTMs with 
the property that their tape T consists of two different tracks (cf. [H Def. 
3.5.5]), an input track I and an output track O. This can be achieved by 
having an alphabet which is a Cartesian product of two alphabets, in our 
case S = {0,1, #} x {0, 1,#}. Then, the tape Hilbert space ?Yt can be 
written as Ti.T = TCq, thus 

nQTM = He ® ?^o ® Wh- 

The transition amplitude 5 generates a linear operator Um on TigrM 
describing the time evolution of the QTM M. We identify a G '^i^ {T~(-{o,i}*) 
with the initial state of M on input a, which is according to the definition 
in [3] a state on T~Lqtm where a is written on the input track over the 
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cell interval [0,i{a) — 1], the empty symbol # is written on the remaining 
cells of the input track and on the whole output track, the control is in the 
initial state qo and the head is in position 0. By linearity, this e.g. means 
that the pure qubit string IV') = (|0) + |11)) is identified with the vector 

(|0#) + |11)) on input track cells number and 1. 

The global state M^{a) E T^{Hqtm) of M on input a at time t G No 
is given by M*{a) = (UmY cr {U^jY . The state of the control at time t is 
thus given by partial trace over all the other parts of the machine, that is 
M^(cr) := TrT.H {M\a)) (similarly for the other parts of the QTM). In 
accordance with [4, Def. 3.5.1], we say that the QTM M halts at time t G N 
on input a G 7^"''('H|o^i}*), if and only if 

(g/|M^(a)|g/) = 1 and (<7/|M^(a)|(7j) = for every t' < t, (2.3) 

where qf ^ Q is the final state of the control (specified in the definition 
of M) signaling the halting of the computation. See Subsection 12.21 for a 
detailed discussion of this condition (Equation (j2.3p l. 

In this thesis, when we talk about a QTM, we do not mean the machine 
model itself, but rather refer to the corresponding partial function on the 
qubit strings which is computed by the QTM. Note that this point of view is 
different from e.g. that of Ozawa [33] who describes a QTM as a map from 
S* to the set of probability distributions on S*. 

We still have to define what is meant by the output of a QTM M, once 
it has halted at some time t on some input qubit string a. We could take 
the state of the output tape Mq((t) to be the output, but this is not a qubit 
string, but instead a density operator on the Hilbert space TCq. Hence, we 
define a quantum operation TZ which maps the density operators on TCq 
to density operators on Wjo,!}*, i-e. to the qubit strings. The operation TZ 
"reads" the output from the tape. 

Definition 2.1.2 (Reading Operation) 

A quantum operationTZ : T[7io) '^('^{o,i}*) called a reading operation, 
if for every finite set of classical strings {si\f^^ C {0, 1}*, it holds that 

where IPd^^)) := |v')(</5| denotes the projector onto \(p). 

The condition specified above does not determine TZ uniquely; there are 
many different reading operations. For the remainder of this thesis, we fix 
the reading operation IZ which is specified in the following example. 
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Example 2.1.3 Let T denote the classical output track configurations as 
defined in Equation i2.2\) . with S = {0, 1,#}. Then, for every t £ T, let 
R(t) be the classical string that consists of the bits of T from cell number 
zero to the last non-blank cell, i.e. 

R : r^{0,l}* 

.. ? ? s # ? 

-2 -1 e(s) + 1 

For every s £ {0, 1}*, there is a countably-infinite number oftGT such that 
R{t) = s. Thus, to every t £ T, we can assign a natural number n{t) which 
is the number oft in some enumeration of the set {t' £ T \ R{t') = R{t)}; 

we only demand that n{t) = 1 if t = [ 

\ -2-10 l(s) l{s) + 1 

Hence, if (as usual) = £^(N) denotes the Hilbert space of square- summable 
sequences, then the map U, defined by linear extension of 

U-.Ho ^ W{o,i}. 

\t) ^ \R{t)) ^\n{t)), 

is unitary. Then, the quantum operation 

n:T{no) ^ T(W|o,ir) 



is a reading operation. 



We are now ready to define QTMs as partial maps on the qubit strings. 

Definition 2.1.4 (Quantum Turing Machine (QTM)) 

A partial map M : T+(W|o,i}*) T^{T-i{o,iY) will be called a QTM, if 
there is a Bernstein- Vazirani two-track QTM M' = (E,Q,(5) (see Def. 
3.5.5) with the following properties: 

. S = {0,1,#} X {0,1, #}, 

• the corresponding time evolution operator Um> is unitary, 

• if M' halts on input a at some time t G N, then M{a) = TZ ^M'q((t)^ , 
where TZ is the reading operation specified in Example \2.1.3\ above. 
Otherwise, M(a) is undefined. 

A fixed- length QTM is the restriction of a QTM to the domain 
[JneNo'^i^ C^'"') l^f^gth eigenstates. We denote the domain of definition 
of a QTM M by domM. 
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The definition of halting, given by Equation ()2.3p . is very important, as 
we will discuss in Section 12.21 On the other hand, changing certain details 
of a QTM's definition, like the way to read the output or allowing a QTM's 
head to stay at its position instead of turning left or right, should not change 
the results in this thesis. 

A simple example of a fixed-length QTM is the identity map on the 
fixed-length qubit strings, which corresponds to a machine that moves the 
contents of the input track to the output track. 

Example 2.1.5 The identity map on the fixed-length qubit strings, i.e. 
id: U '7'i+(W„) - U 

n6No nSNo 
P ^ P 

is a fixed-length QTM. 

Proof. We start by defining a classical Turing machine that moves the 
content of the input track to the output track and halts. Let S := {0, 1, 
and Q = {qo,qf}. We look for a transition function S'.QxTi^Qx'Ex 
{L, R} such that 

(go,##) ^ {qf,##,R), 

(90, 0#) ^ (go,#0,i?), 
(90, 1#) ^ {qo,#l,R). 

This is not a complete definition, since we do not specify the action of 6 on 
all the other configurations, but Corollary B.0.15] guarantees that 5 can 
be extended to a total function on all the configurations in some way (that 
we are not interested in) such that the resulting TM M is reversible as long 
as the following two conditions are satisfied: 

(1.) Each state can be entered only from one direction, i.e. if 6{pi,ai) = 
(g,Ti,di) and 5{p2,cr2) = iq,T2,d2), then di = d2. 

(2.) The transition function 6 is one-to-one when direction is ignored. 

It is easily checked that both conditions are satisfied here. Moreover, it is not 
difficult to see that the classical, reversible TM M defined by the transition 
function 6 moves the content of the input track bit by bit to the output track 
(while remaining in state qo) just until it detects the first blank symbol on 
the input track; in this case, it turns one more step to the right and halts. 

As M is a reversible TM, M is also a Bernstein- Vazirani QTM with 
unitary time evolution, and thus, Af is a QTM in the sense of Definition 1 2 . 1 
one that maps every classical binary string onto itself. Since the halting time 
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and the final position of tlie liead of M only depend on the length of the 
input, it follows that superpositions of classical strings of common length are 
mapped to superpositions (the same is true for mixtures). Thus, M{p) = p 
for fixed-length qubit strings p. □ 

Given that an identity machine is simple to define on fixed-length inputs 
(it just moves the contents of the input track to the output track), it is 
perhaps surprising that this is not a QTM on indeterminate-length inputs. 
The reason is that if the input has indeterminate length, there is no way 
to determine when the process of moving the contents to the other track 
should halt: it halts at a superposition of different times if it is programmed 
as in the previous example, and this contradicts the halting conditions of 
Equation (|23]) . 



Example 2.1.6 The identity map on the indeterminate-length qubit 
strings, i.e. 

id:T+(W|o,i}0 - T+{n{o,iy) 
p ^ p 

is not a QTM. 

Proof. Suppose the identity map on the indeterminate-length qubit strings 
was a QTM. Let p G T'^ {H^Q^ij*) be an arbitrary indeterminate-length qubit 
string, and let r G N denote the corresponding halting time of the QTM id 
on input and output p. Let a E (Ti^Q^iy*) be another qubit string with 
£{a) > T. 

For e e (0, 1), let pe := (1 - e)p + ea. It follows that l{pe) = i{cr) > r. 
Since a QTM can only write one cell of the output tape at a time, it follows 
that the halting time corresponding to ps must be larger than r. Note that 

\\P - PelWr = Ik/0 - ecrllTr = £\\p " 0-||Tr < £• (2.4) 

We know from the halting conditions in Equation (|2.3p that 

(9/|idc(p)k/) = 1 and {qf\id''c{pe)\qf) = 0. 
Thus, we get the inequality 



ip-PsU = \\iu,^ypiu*^y-iu,^ypsiu:^y 

= ||id-(p)-id-(p,)||T, 

> \\idhip)-idhiPs)\\Tr = ^ 



iTr 



which contradicts Equation ()2.4p . □ 

For defining quantum Kolmogorov complexity, we will sometimes need 
to give two inputs to a QTM, namely some qubit string a E '?i'^('^{o,i}*) '^'^^ 
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an integer /c G N both at the same time. Similarly as in the classical case, 
we can join a and a self-delimiting description € {0, 1}* of k together by 
concatenation (which, in the quantum case, is just the tensor product). 

How can we do this? Since a may be a superposition or mixture of 
classical strings of different lengths, it makes no sense to input a ® into 
the QTM, since the QTM cannot extract st from the resulting qubit string. 
But there is no problem with the other way round, i.e. to input CS>c. This 
leads to the following definition: 

Definition 2.1.7 (Parameter Encoding) Let A; G N and a G 

7^'^(7^{o,i}*)- define an encoding (•,•) : N x {T-L^Q^iy) —>■ '^^('^{0,1}*) 
of a pair (k, a) into a single qubit string {k, a) by 

{k,a) := \sk){sk\ cr. 

Here, s^ is the following self- delimiting description of k: 

Sk '■= j-lll^- • ■ 4 {binary digits of k) . (2-5) 
[logfcj LiogfcJ+i 

For every QTM M, we then set M{k,a) := M{{k,a)). Moreover, if 6 e Q'^ 
is a rational number with ^ = if^, and this fraction cannot be reduced any 
further, then we define 

M{6,a) ■.= M{{l,{m,a))) . 

There are many other possibilities to encode an integer k into some 
self-delimiting binary string s^. We chose this encoding since it is efficient 
enough for our purpose (e.g. we can prove some relation like Lemma l3.1.2p . 
but another choice of encoding will not change the results of this thesis. See 
also the discussion after Lemma 13.1.21 Also note that 

£{{k,a)) =2[logk\ + 2 + e{a), (2.6) 

and the same equation holds true for average length I. 

In this thesis, we will sometimes consider the map a — > M{k, a) for some 
QTM M and some fixed integer k. We would like to apply everything that 
we have learnt about QTMs to maps like this. Thus, the following lemma 
will be useful: 



Lemma 2.1.8 For every QTM M and /c G N, the map a ^ M{k,a) is 
itself a QTM. 
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Proof. Let Sk be the self-delimiting description of k as specified in Equa- 
tion (j2.5p . Moreover, let Tf^ denote a classical reversible Turing machine that, 
ignoring its input, prints the classical string Sk G {0, 1}* onto its input track 
cells left of the starting cell, i.e. onto the track segment [— ^(sfc),— 1], and 
then halts with the head pointing to the cell in position —i{sk)- As we know 
that these input track cells start with the empty symbol, this can be done 
reversibly. 

Since the reversible TM is also a QTM, there is a QTM that carries out 
the computation of Tk , followed by the computation of M (cf . Dovetailing 
Lemma]). Nevertheless, the resulting QTM is not exactly what we want, 
since it will produce M's output on input {k, a) starting in output cell 
number —i{sk), not in cell 0. 

To circumvent this problem, we construct some modification M' of M, 
which then will give the correct output, if it is joined to T^. To simplify the 
discussion, we describe the solution for the special case that has length 
one. Moreover, we restrict the proof to the situation that M is a classical 
reversible TM; the quantum generalization will be straightforward. 

If M's head points to some cell number m €z Z, then M reads and writes 
cell number m of the input track, and at the same time cell number m of 
the output track. The trick now is to program M' in such a way that it 
effectively reads and writes input track cell m, but output track cell m + 1. 
We choose the control state space Q' of M' to be three times as large as 
M's state space Q: 

Q' :=Qx {1,2,3}. 

Now we construct some modified transition function 6' for the QTM M' 
from M's transition function 6. Suppose that one of the transition rules for 
M is, for example, 

g5,(0,l)^Q6,(l,#),i, 

which says that whenever M is in state and reads the symbol on the 
input track and 1 on the output track, then it turns into state qq, writes a 
1 onto the input track and a blank symbol onto the output track and then 
turns left. 

We decompose this step into three steps for M': 

((?5,1),(0,-) ^ ((?5,2),(0,-),ii 

(95, 2), (.,1) ^ (g5,3),(.,#),L 

((?5,3),(0,-) ^ ((?6,l),(l,-),i 

Here, • and • denote arbitrary symbols (zero, one, or blank). The succes- 
sion of steps that M' performs with that transition function is depicted in 
Figure 



2.2. Halting and Universality of QTMs 



21 










• 












1 














• 












1 












• 








# 







1 


• 








# 





Figure 2.3: modified Turing machine 



If the computations of are followed by the modified QTM M', then 
the output of the resulting QTM will thus he M{k, a). □ 



2.2 Halting and Universality of QTMs 

There has been a vivid discussion in the literature on the question when 
we can consider a QTM as having halted on some input and how this is 
compatible with unitary time evolution, see e.g. [29l [2ll [32l HOj [25] . We will 
not get too deep into this discussion, but rather analyze in detail the simple 
definition for halting by Bernstein and Vazirani , which we also use in this 
thesis, as specified in Equation ()2.3p . We argue below that this definition is 
useful and natural, at least for the purpose to study quantum Kolmogorov 
complexity. 

Note that whatever definition of "halting" we choose for a QTM, there 
is one problem which is unavoidable in principle, originating from quantum 
theory itself. Suppose we are given some classical string s £ {0,1}*, and 
we want to find out whether s is halting for a given classical TM T or not, 
i.e. if T halts on input s or not0 Then, we can always input s into the TM 
r, and observe T's computation for a long time. Once we observe halting 
of T, we know for sure that s is halting, of course. If we have waited for a 
very long time and have not observed halting of T, we may believe that s is 
non-halting, although we can never be sure. Yet, if T is a very simple TM 
for which we can predict the time evolution completely, then we may find a 
proof that s is non-halting for T. 

If we define some notion of "halting" for a QTM and qubit strings, this 
means that we split the space of qubit strings into two parts: the halting 
qubit strings H and the non-halting qubit strings A^. 

n{o,i}* =HUN and H n N = ^. 

It follows immediately that H and N cannot be orthogonal, i.e. 

H JLN. 



^In this discussion as well as in the remainder of this thesis, we call some bit or qubit 
string s halting for a TM or QTM M, if M halts on input s. 
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Thus, if we have some unknowru quantum state l-^), and we are given the 
description of some QTM M, then it is unavoidable that at least one of the 
following two problems occurs: 

(a) It may be true that is halting for M, but we cannot find out with 
certainty by any possible measurement that this is true. 

(b) It may be true that \tp) is non-halting for M, but we cannot prove this 
with certainty by any possible measurement, even if M is so simple 
that we can completely predict its time evolution. 

It is impossible to get rid of both problems at once, but the definition of 
halting in this thesis avoids problem (a), i.e. in principle, one can find out 
by measurement with certainty if some input is halting for a QTM. Recall 
from Subsection 12.1.21 how we have defined that a QTM M halts on some 
input at time t: according to Equation (j2.3p . we demand that 

(g/|M*,(|V')(V'|)k/) = 1 and {qf\M'cmm\qf) = ^ for every < t. 

Thus, given some unknown quantum state if it is halting, then we 
can find out for sure that it is, at least in principle, by supplying it as 
input to M and periodically observing the control state. The aforementioned 
halting conditions guarantee that projective measurements with respect to 
the projectors \qf){qf \ and 1 — \qf){qf \ do not spoil the computation. 

As the control state M^(|t/;)(?/;|) = TrjoH (f^MlV')(V'l(t^M)*) is, in gen- 
eral, some mixed state on the control's Hilbert space Tic, the overlap with 
the final state \qf) will generally be some arbitrary number between zero and 
one. Hence, for most input qubit strings there will be no time t G N such 
that the aforementioned halting conditions are satisfied. We call those qubit 
strings non-halting in accordance with the discussion above, and otherwise 
t-halting, where t is the corresponding halting time. 

In Subsection 12.3.11 we analyze the resulting geometric structure of the 
halting input qubit strings. We show that inputs 1-0) G Ti-n with some fixed 
length n that make the QTM M halt after t steps form a linear subspace 
'H^^(i) C Tin- Moreover, inputs with different halting times are mutually 
orthogonal, i.e. Ti-^^j {t) _L Tl^^^{t') if t 7^ t'. According to the halting condi- 
tions given above, this is almost obvious: Superpositions of t-halting inputs 
are again t-halting, and inputs with different halting times can be perfectly 
distinguished, just by observing their halting time. 

In Figure 12.41 a geometrical picture of the halting space structure is 
shown: The whole space represents the space of inputs of some fixed 
length n, i.e. Tin, while the plane and the straight line represent two different 
halting spaces TL^^\t') and T-6^^{t). Every vector within these subspaces is 

■^"Unknown" here means that we do not have a classical description of e.g. we do 
not know exactly how the state was created, and thus cannot obtain any copy of 
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perfectly halting, while every vector "in between" is non-halting and not 
considered a useful input for the QTM M. 



At first, it seems that the halting conditions given above are far too 
restrictive. Don't we loose a lot by dismissing every input which does not 
satisfy those conditions perfectly, but, say, only approximately up to some 
small e? To see that it is not that bad, note that 

• most (if not all) of the well-known quantum algorithms, like the quan- 
tum Fourier transform or Shor's algorithm, have classically controlled 
halting. That is, the halting time is known in advance, and can be 
controlled by a classical subprogram. 

• in Section 12.41 we show that every input that is almost halting can 
be modified by adding at most a constant number of qubits to halt 
perfectly, i.e. to satisfy the aforementioned halting conditions. This 
can be interpreted as some kind of "stability result" , showing that the 
halting conditions are not "unphysical" , but have some kind of built-in 
error tolerance that was not expected from the beginning. 

Moreover, this definition of halting is very useful. Given two QTMs Mi 
and M2, it enables us to construct a QTM M which carries out the compu- 
tations of Ml, followed by the computations of AI2, just by redirecting the 
final state \qf) of Mi to the starting state \qo) of M2 (see [4, Dovetailing 
Lemma 4.2.6]). In addition, it follows from this definition that QTMs are 
quantum operations (cf . Lemma I2.3.4p , which is a very useful and plausible 
property. 

Even more important, at each single time step, an outside observer can 
make a measurement of the control state, described by the operators \qf){qf\ 
and 1 — \qf){qf \ (thus observing the halting time), without spoiling the com- 
putation, as long as the input is halting. As soon as halting is detected, 
the observer can extract the output quantum state from the output track 
(tape) and use it for further quantum information processing. This is true 




Figure 2.4: Mutually Orthogonal Halting Spaces 
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even if the halting time is very large, which typically happens in the study 
of Kolmogorov complexity. 

Finally, if we instead introduced some probabilistic notion of halting (say, 
we demanded that we observe halting of the QTM M at some time t with 
some large probability p < 1), then it would not be so clear how to define 
quantum Kolmogorov complexity correctly. Namely if the halting probability 
is much less than one, it seems necessary to introduce some kind of "penalty 
term" into the definition of quantum Kolmogorov complexity: there should 
be some trade-off between program length and halting accuracy, and it is 
not so clear what the correct trade-off should be. For example, what is the 
complexity of a qubit string that has a program of length 100 which halts 
with probability 0.6, and another program of length 120 which halts with 
probability 0.9? The definition of halting that we use in this thesis avoids 
such questions. 

2.2.1 Different Notions of Universality for QTMs 

Bernstein and Vazirani [Ij have shown that there exists a universal QTM 
(UQTM) lA. It is important to understand what exactly they mean by "uni- 
versal". According to ^ Thm. 7.0.2], this UQTM U has the property that 
for every QTM M there is some classical bit string sa/ G {0, 1}* (containing 
a description of the QTM M) such that 

\\U{sM,T,5,m - no MlimW^^ < 6 (2.7) 

for every input {tp), accuracy 6 > and number of time steps T G N. 

This means that the UQTM U simulates every other QTM M within any 
desired accuracy and outputs an approximation of the output track content 
of M and halts, as long as the number of time steps T is given as input in 
advance. 

Since the purpose of Bernstein and Vazirani's work was to study the 
computational complexity of QTMs, it was a reasonable assumption that 
the halting time T is known in advance (and not too large) and can be 
specified as additional input. The most important point for them was not to 
have short inputs, but to prove that the simulation of M by Z^/ is efficient, 
i.e. has only polynomial slowdown. 

The situation is different if one is interested in studying quantum Kol- 
mogorov complexity instead. It will be explained in Subsection 12.2.21 below 
that the universality notion ()2.7p is not enough for proving the important 
invariance property of quantum Kolmogorov complexity, which says that 
quantum Kolmogorov complexity depends on the choice of the universal 
QTM only up to an additive constant. 

To prove the invariance property, one needs a generalization of (|2.7p . 
where the requirement to have the running time T as additional input is 
dropped. We show below in Subsection 12.2.31 that there exists a UQTM it 
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that satisfies such a generahzed universality property, i.e. that simulates 
every other QTM until that other QTM has halted, without knowing that 
halting time in advance, and then halts itself. 

Why is that so difficult to prove? At first, it seems that one can just 
program the UQTM li mentioned in (j2.7|) to simulate the other QTM M 
for T = 1,2,3,... time steps, and, after every time step, to check if the 
simulation of M has halted or not. If it has halted, then li halts itself and 
prints out the output of M, otherwise it continues. 

This approach works for classical TMs, but for QTMs, there is one prob- 
lem: in general, the UQTM lA can simulate M only approximately. The 
reason is the same as for the circuit model, i.e. the set of basic unitary trans- 
formations that lA can apply on its tape may be algebraically independent 
from that of M, making a perfect simulation in principle impossible. But if 
the simulation is only approximate, then the control state of M will also be 
simulated only approximately, which will force li to halt only approximately. 
Thus, the restrictive halting conditions given above in Equation (j2.3p will 
inevitably be violated, and the computation of lA will be treated as invalid 
and be dismissed by definition. 

This is a severe problem that cannot be circumvented easily. Many ideas 
for simple solutions must fail, for example the idea to let lA compute an 
upper bound on the halting time T of all inputs for M of some length n 
and just to proceed for T time steps: upper bounds on halting times are not 
computable. Another idea is that the computation of lA should somehow 
consist of a classical part that controls the computation and a quantum 
part that does the unitary transformations on the data. But this idea is 
difficult to formalize. Even for classical TMs, there is no general way to split 
the computation into "program" and "data" except for special cases, and 
for QTMs, by definition, global unitary time evolution can entangle every 
part of a QTM with every other part. 

Our proof idea rests instead on the observation that every input for a 
QTM which is halting can be decomposed into a classical and a quantum 
part, which is related to the mutual orthogonality of the halting spaces. 
The proof is given in Section 12.31 Note that we have already published the 
contents of this and the following section in |28] . 

2.2.2 Quantum Complexity and its Supposed Invariance 

As already explained in the introduction, the classical Kolmogorov complex- 
ity Cm{s) of a finite bit string s G {0, 1}* is defined as the minimal length 
of any computer program p that, given as input into a TM M, outputs the 
string s and makes M halt: 



Cm{s) ■■= min{£(p) | M{p) = s} . 
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For this quantity, running times are not important; all that matters is the 
input length. There is a crucial result that is the basis for the whole theory 
of Kolmogorov complexity (see [23]). Basically, it states that the choice 
of the computer M is not important as long as M is universal; choosing 
a different universal computer will alter the complexity only up to some 
additive constant. More specifically, there exists a universal computer U 
such that for every computer M there is a constant cm G N such that 

Cu{s) < Cm{s) + CM for every s e {0, 1}*. (2.8) 

This so-called "invariance property" follows easily from the following fact: 
there exists a computer U such that for every computer M and every input 
s £ {0,1}* there is an input s' G {0,1}* such that U{s') = M(s) and 
i{s') < i{s) + Cm, where cm G N is a constant depending only on M. In 
short, there is a computer U that produces every output that is produced by 
any other computer, while the length of the corresponding input blows up 
only by a constant summand. One can think of the bit string s' as consisting 
of the original bit string s and of a description of the computer M (of length 
Cm)- 

As the invariance property is so important for the theory of classical 
Kolmogorov complexity, a study of quantum Kolmogorov complexity natu- 
rally asks for a quantum analogue of this property. The notion of quantum 
complexity that we shall define in Chapter [3] is a slight modification of the 
definition given by Berthiaume et al. in A closely related quantity has 
been considered recently by Rogers and Vedral [37] . 

In both cases [5] and [3^, it is claimed that quantum Kolmogorov com- 
plexity is invariant up to an additive constant similar to (|2.8p . Nevertheless, 
in [37j no proof is given and the proof in [5] is incomplete: in that proof, it 
is stated that the existence of a universal QTM U in the sense of Bernstein 
and Vazirani (see Equation ()2.7p ) makes it possible to mimic the classical 
proof and to conclude that the UQTM U outputs all that every other QTM 
outputs, implying invariance of quantum Kolmogorov complexity. 

But this conclusion cannot be drawn so easily, because (j2.7p demands 
that the halting time T is specified as additional input, which can enlarge 
the input length dramatically, if T is very large (which typically happens in 
the study of Kolmogorov complexity) . 

As explained above in Subsection 12.2. 1^ it is not so easy to get rid of 
the halting time. The main reason is that the UQTM U can simulate other 
QTMs only approximately. Thus, it will also simulate the control state and 
the signaling of halting only approximately, and cannot just "halt whenever 
the simulation has halted" , because then, it will violate the restrictive halting 
conditions given in Equation (|2.3p . As we have chosen this definition of 
halting for good reasons (cf. the discussion at the beginning of Section 12.21 
above), we do not want to drop it. So what can we do? 
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The only way out is to give a proof that despite our restrictive definition 
of halting, there still exists some UQTM il that simulates every other QTM 
until that other QTM has halted, even if it does not know the halting time 
in advance. Yet, it is not enough to rely on the result (j2.7p by Bernstein and 
Vazirani; we need another good idea how to do it. We describe our proof idea 
in the next subsection, while the proof will be given below in Section 12.31 

2.2.3 Strongly Universal QTMs 

We are going to prove in Section [2.31 below that there is "strongly universal" 
QTM that simulates every other QTM until the other QTM has halted and 
then halts itself. Note that the halting state is attained by It exactly (with 
probability one) in accordance with the strict halting definition given in 
Equation dO]) . 



Theorem 2.2.1 (Strongly Universal Quantum Turing Machine) 

There is a fixed-length quantum Turing machine il such that for every QTM 
M and every qubit string a for which M(a) is defined, there is a qubit string 
aM such that 

\\iX{5,aM)-M{a)\\r^^<5 

for every 6 G Q^, where the length of gm is hounded by i{crM) < ^(c) + cm, 
and Cm G N is a constant depending only on M. 



Note that (Tm does not depend on 6. 

In Chapter [Sj we study several notions of quantum Kolmogorov com- 
plexity at once. To prove invariance for every single notion, we shall also 
prove the following slight modifications of Theorem 12.2.11 



Proposition 2.2.2 (Parameter Strongly Universal QTM) 

There is a fixed-length quantum Turing machine il with the property of Theo- 
rem \2.2.1\ that additionally satisfies the following: For every QTM M and ev- 
ery qubit string a S ("^{o.i}*)? there is a qubit string aM £ '^i^ ("^{o,!}*) 
such that 

||il(A;,c7M) - M(2/c,cj)||ti. < for every k eN 

if M {2k, a) is defined for every k £ 'N, where the length of aM is bounded 
by i{aM) < ^(o") + Cm, and cm G N is a constant depending only on M. 



It may first seem that this Proposition 12.2.21 is a simple corollary of 
Theorem 12.2. H but this is not true. The problem is that the computation 
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of M(2/c, cr) may take a different number of time steps tk for different k 
(typically, — > oo as A; — > cxd). Just using the result of Theorem 12.2.11 would 
give a corresponding qubit string o"m that depends on k, but here we demand 
that the qubit string aM is the same for every k, which will be important 
for proving Theorem 13.3.11 

We also sketch some proof idea for the following conjecture: 

Conjecture 2.2.3 (Average-Length Strongly Universal QTM) 

There is a prefix QTM^ such that for every prefix QTM M and every qubit 
string a for which M{a) is defined, there is a qubit string gm such that 

\m5,aM)-M{a)\\Tr<5 

for every 5 G Q"*", where the average length of aM is bounded by £{crM) < 
i{a) + Cm, and cm G N is a constant depending only on M. 

We define the notion of a prefix QTM in Definition 12.3.51 The reason why 
we give a proof idea for this conjecture is that it explains why it seems that 
we need the condition that M has to be prefix-free. This supports the point 
of view that average length I is intimately connected with the notion of 
prefix- free qubit strings. 

We give a full proof of Theorem 12.2.11 describing in every single detail 
how the corresponding UQTM il works, below in Section 12.31 This involves 
many analytic estimates to prove that certain numerical approximations 
made by it are accurate enough. 

Since the technical details are so similar, we will only sketch the proof 
of Proposition 12.2.21 in Section 12.31 Although we have a proof sketch of 
Conjecture 12.2.31 we do not think that we have settled it completely (in 
contrast to Proposition I2.2.2P because it depends heavily on the property 
that the domain of definition of the QTM is prefix-free, and it is not clear 
that this fact survives the numerical approximations done by the QTM 53. 
In the remainder of this subsection, we describe the ideas of the proof of 
Theorem 12.2.11 

The proof of Theorem 12.2.11 relies on the observation about the mutual 
orthogonality of the halting spaces, as explained above at the beginning of 
Section [2T2I Fix some QTM M, and denote the set of vectors {tp) € Tin which 
cause M to halt at time t by wjy^^(t). U \(p) G Tin is any halting input for 
M, then we can decompose \ip) in some sense into a classical and a quantum 
part. Namely, the information contained in \(p) can be split into a 

• classical part: The vector \ip) is an element of which of the subspaces 

w£)(t)? 

• quantum part: Given the halting time r of \ip), then where in the 
corresponding subspace TL^^^{t) is \ip) situated? 
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Our goal is to find a QTM H and an encoding |(^) G Hn+i of \(p) which is 
only one qubit longer and which makes the (cleverly programmed) QTM 
il output a good approximation of M(| (/?)). First, we extract the quantum 
part out of \ip). While dimH„ = 2", the halting space Ti.^}^^ {t) that contains 
\^p) is only a subspace and might have much smaller dimension d < 2". This 
means that we need less than n qubits to describe the state \(p); indeed, 
[log tf| qubits are sufficient. In other words, there is some kind of "standard 
compression map" C that maps every vector |^) G T~(-m\'^) Rogd]- 
qubit-space (cS^^r^"^'^^ Thus, the qubit string C\(p) of length [logcZ] < n 
can be considered as the "quantum part" of \ip). 

So how can the classical part of \ip) be encoded into a short classical 
binary string? Our task is to specify what halting space T^j^^ (r) corresponds 
to \(p). Unfortunately, it is not possible to encode the halting time r directly, 
since r might be huge and may not have a short description. Instead, we 
can encode the halting number. Define the halting time sequence {tij^i as 
the set of all integers t G N such that dimK^^(t) > 1, ordered such that 
ti < ^i+i for every i, that is, the set of all halting times that can occur on 
inputs of length n. Thus, there must be some i G N such that r = ti, and 
i can be called the halting number of \ip). Now, we assign code words Cj to 
the halting numbers i, that is, we construct a prefix code {cj}^^ C {0, 1}*. 
We want the code words to be short; we claim that we can always choose 
the lengths as 

^(Q) = n + 1- riogdimHi?(t,)l . 
This can be verified by checking the Kraft inequality: 

N N 

i=l i=l 
n 

< 2-" J2 dim (ti) < dim Hn 

i=l 

< 1, 

since the halting spaces are mutually orthogonal. 

Putting classical and quantum part of \ip) together, we get 

\(p) := Ci f^C\(p) , 

where i is the halting number of {(p). Thus, the length of \(p) is exactly n+ 1. 

Let sm be a self-delimiting description of the QTM M. The idea is to 
construct a QTM il that, on input sm ^ |(^), proceeds as follows: 

• By classical simulation of M, it computes descriptions of the halting 
spaces Ti^^ {l),Ti^^ (2), (3), . . . and the corresponding code words 
ci, C2, C3, . . . one after the other, until at step r, it finds the code word 
Ci that equals the code word in the input. 
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• Afterwards, it applies a (quantum) decompression map to approxi- 
mately reconstruct \Lp) from C|(/?). 

• Finally, it simulates (quantum) for r time steps the time evolution of 
M on input \ip) and then halts, whatever happens with the simulation. 

Such a QTM il will have the strong universality property as stated in The- 
orem I2.2.1[ Unfortunately, there are many difficulties that have to be over- 
come by the proof in Section 12. 3t 

• Also classically, QTMs can only be simulated approximately. Thus, it is 
for example impossible for it to decide by classical simulation whether 
the QTM M halts on some input \lp) perfectly or only approximately 
at some time t. Thus, we have to define certain (^-approximate halting 
spaces H^M'^\t) and prove a lot of lemmas with nasty inequalities. 

• According to the statement of Theorem I2.2.H we have to consider 
mixed inputs and outputs, too. 

• The aforementioned prefix code must have the property that one code 
word can be constructed after the other (since the sequence of all 
halting times is not computable), see Lemma 12.3.161 

We show that all these difficulties (and some more) can be overcome, and 
the idea outlined above can be converted to a formal proof of Theorem 12.2. II 
which we give in full detail in Section 12.31 

2.3 Construction of a Strongly Universal QTM 

The aim of this section is to give a full proof of Theorem I2.2.1i This will 
be done in several steps: In Subsection 12.3. H we show that the domain of 
definition of a QTM is given by mutually orthogonal halting spaces. After- 
wards, we show in Subsection 12.3.21 that these subspaces have computable 
approximations, and we prove several properties of the corresponding "ap- 
proximate halting spaces" . In Subsection 12.3.31 we explain how the classical 
and quantum part of some input can be coded and decoded by the UQTM 
il. Finally, in Subsection 12.3.41 we put all these partial results together to 
construct the strongly universal QTM il mentioned in Theorem I2.2.1[ 

2.3.1 Halting Subspaces and their Orthogonality 

As already explained at the beginning of Section 12.21 restricting to pure 
input qubit strings G 'Hn of some fixed length i{\4>)) = n, the vectors 
with equal halting time t form a linear subspace oiTCn- Moreover, inputs with 
different halting times are mutually orthogonal, as depicted in Figure 12.41 
We will now use the formalism for QTMs introduced in Subsection 12.1.21 
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to give a formal proof of these statements. We use the subscripts C, I, O 
and H to indicate to what part of the tensor product Hilbert space a vector 
belongs. 

Definition 2.3.1 (Halting Qubit Strings) 

Let a G '^"''('^{o.i}*) ^ qubit string and M a quantum Turing machine. 
Then, a is called t-halting (for M), if M halts on input a at time i G N. We 
define the halting sets and halting subspaces 

HM{t) := {IV') GH|o,i}. I is t-halting for M}, 

HMit) ■■= {a\i:) I m eHM{t),aeW}, 

H^;^\t) := HM{t)nnn, ni\t):=nM{t)nnn. 

Note that the only difference between (t) and (t) is that the latter 

set contains non- normalized vectors. It will be shown below that H^^\t) is 
indeed a linear subspace. 



Theorem 2.3.2 (Halting Subspaces) 

For every QTM M, n G No and t G N, the sets HM{t) and 'H^^ {t) are linear 
subspaces o/Wjo,!}* resp. Tin, and 

n^^\t) ±n^^\t') and nM(t)±nM{t') for every t t' . 



Proof. Let \ip), G HM{t)- The property that \ip) is t-halting is equiv- 
alent to the statement that there are states |$* ) G Hi® Ho ® Hyi and 
coefhcients c*' G C for every t' <t and q E Q such that 

^m(I<^)i®I*o)) = |g/)c®|$*,), (2.9) 
VMilfh'^l^o)) = ^4\q)c<^\^q) for every i' < t, (2.10) 

where Vm is the unitary time evolution operator for the QTM M as a whole, 
and l^'o) = |'7o)c'X'|#)o® |0)h denotes the initial state of the control, output 
track and head. Note that 1^*0) does not depend on the input qubit string 
(in this case \ip))- 

An analogous equation holds for \tp), since it is also t-halting by assump- 
tion. Consider a normalized superposition a\ip) + Plip) G K{o,i}*: 

y^((a|99)i+/3|V)i)C5|*o)) = aV^\ip)i0\^o)+pV^\i;)i®\^o) 

= a\qf)c'^\^l^)+P\qf)c'^\^f) 
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Thus, the superposition also satisfies condition ()2.9p . and, by a similar cal- 
culation, condition (j2.10p . It follows that + l3\ip) must also be t-halting. 
Hence, Ti-Aiit) is a linear subspace of "Hjo,!}*- As the intersection of linear 
subspaces is again a linear subspace, so must be H^^j{t). 

Let now \ip) £ HM{t) and 1-0) G HM{t') such that t < t' . Again by 
Equations and dTTU]) . it holds 

{ip\^) = (i(v^|®(^o|)(nV)*nV(lV')i55|^o)) 

= E 4 c(g/k)c-(^*,|«>*) = o. 

It follows that TiMit) -L TiMit'), and similarly for n^^j{-) C Wm(-)- ° 

The physical interpretation of the preceding theorem is straightforward: by 
linearity of the time evolution, superpositions of t-halting strings are again 
i-halting, and strings with different halting times can be perfectly distin- 
guished by observing their halting time. 

It is now clear what the domain of definition of a QTM looks like: 



Lemma 2.3.3 (Domain of Definition of a QTM) 

If M is a QTM, then its domain of definition is given by 

domM= jT+(WM(i)), 

i.e. the set of density operators on the linear subspaces of pure t-halting qubit 
strings. 



Proof. Let a £ domM have spectral decomposition a = Aj|V'i)(V'i|! 
with Aj > 0. Let t be the halting time that corresponds to a. Then, 

Y,>^r{qf\M'cmm\qf) = { I 

It follows that each element of this convex combination must itself satisfy 
this equation. Thus, £ Ti.Mit), and a is a density operator on 7iM{t). □ 

In general, different inputs a have different halting times t and the corre- 
sponding outputs are essentially results of different unitary transformations 
given by where Um denotes M's time evolution operator. However, the 
action of the partial map M on dom M may be extended to a valid quantum 
operation on T{Ti.^Q iy*): 
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Lemma 2.3.4 (QTMs are Quantum Operations) 

For every QTM M there is a quantum operation Ai : '?'('^^{o,i}* ) 
T{7i^Q iy), such that for every a G domM 

M(cj) =M{a). 



Proof. Let Bt and B± be an orthonormal basis of TiMit), t £ N, and 
the orthogonal complement of ©^^^^4/(0 within TC^Q iy*, respectively. We 
add an ancilla Hilbert space TIa '■= ^^(Nq) to the QTM, and define a lin- 
ear operator Vm '■ "^{o,!}* ~^ 'Hqtm ® by specifying its action on the 
orthonormal basis vectors Ut(=nBt U B±: 

\b)0\O) ii\b)eB^. ^^-^^^ 

Since the right hand side of (|2.11|) is a set of orthonormal vectors in 
T~(-QTM ® Ti-A, the map Vm is an isometry (i.e. V^Vm = !)• Thus, the map 
(T I— > Vmc^Vm is trace-preserving, completely positive (see [HI [22l [35])- Its 
composition with the partial trace, given by Ai{a) := TrcHiA(V7\/f(7V^j), is 
a quantum operation. □ 

In the following, it will turn out that it is interesting to study prefix 
QTMs, i.e. QTMs which are in a certain sense quantum generalizations 
of classical prefix Turing machines. A classical TM is called prefix if its 
domain of definition is a prefix- free set. We can define a natural quantum 
generalization by calling a QTM prefix if its domain of definition in the qubit 
strings is in a certain sense prefix-free, too. Following the lines of Schumacher 
and Westmoreland [39j, who have defined prefix-free quantum codes, leads 
us to Definition 12.3.51 below. 

To state the definition, we fix some notation. If a classical string s € 
{0, 1}* has length i{s) > n, then the string s" is defined to consist of the 
first n bits of s. Thus, s" is the prefix of s of length i{si) = s. 

Similarly, we can define the prefix of a qubit string a € {Ti^Q^iy*) 
in a simple way. First, we identify the qubit string a with the corresponding 
density operator on the QTM's output tape Hilbert space a' G 7^^(7^0)5 
such that the string is "written" onto the blank tape, starting in cell 0, 
and ending in cell i{a) — 1, as the input for a QTM has been defined in 
Subsection 12. 1.2I Then, we define the prefix (cr")' by the partial trace 

«)' := Tr(_^,„i]u[„,^)a' G T+ ((do.i.#})«") . 

Let t G {0, 1, be any configuration which is not of the form • • • 
where s G {0, 1}* is a binary string (for example, t = 0#1)- Then it is easy to 
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see that = 0. Thus, (a^)' is a superposition and mixture of classi- 

cal strings embedded on the tape, and can be identified with a corresponding 
qubit string cr" G 7^"^(?^{o,i}*)- 

Definition 2.3.5 (Prefix QTM) 

A QTM M is called prefix if for every pair of pure qubit strings \(f){(p\, 
e domM with £{\(p)) > e{\ip)) =: n, it holds 

(^l(l<^)H5^)l^)=0, 

where \^p){'^\i is the qubit string consisting of the first n qubits of as 
defined above. 

The following lemma shows that the prefix property of QTMs resembles the 
prefix property of classical TMs: 



Lemma 2.3.6 If M is a prefix QTM, then 

a G domM domM for every n < £{a). 



Proof. Let M be a prefix QTM, and let a G domM with £{a) > n G Nq. 
If cr = J2j is spectral decomposition of a with \j > for every 

j, then there must be some j such that £{\<Pj)) = £{cr) > n; fix this j until 
the end of the proof. 

Suppose £ domM with i{\ip)) < n. As M is prefix, we get 

> {'^\^m{\vj){vjri)\^)^m>o, 

identifying a qubit string \ip) G W^o,!}* with the corresponding vector 
on the tape Hilbert space Hq. Thus, l'^) _L supp {\ipj){ipj\i), and since 
^{\fj){'Pj\i) ^ it follows that \<fj){<fj\i domM. But 

j 

so cj" as well cannot be halting for M, and so a" domM. □ 

2.3.2 Approximate Halting Spaces 

We start by defining the notion of approximate halting. 
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Definition 2.3.7 (e-t-halting Property) A qubit string a G '^i' 0~(-{o,i}*) 

will be called e-t-halting for M for some t e N, e > and M a QTM, if and 
only if 



{Qf\Mk<^)\qf) 



<e fort'<t, 
>l-e fort' = t . 



Let Sn '■= {IV') £ "^n I = 1} be the unit sphere in Tin, and let 

U5{\^)) := {IV') G Hn I II IV') - |<^)l| < be an open ball. The ball Us{\^)) 
will be called s-t-halting for M if there is some |V') G Us{\ip)) fl Sn which is 
s-t-halting for M. Moreover, we use the following symbols: 

• dist(S', := infsg5 || \s) — |<^)|| for any subset S C Hn and \ip) G Hn, 

• := {\^) eHn I {ek\<p) G Q + zQ Vk}, where {\ek)}T=i denotes 
the computational basis vectors of Tin, 

• b°) := for every vector \ip) eUnX {0}. 

The set of vectors with rational coordinates, denoted 7^^, wih in the fol- 
lowing be used frequently as inputs or outputs of algorithms. Such vectors 
can be symbolically added or multiplied with rational scalars without any 
error. Also, given |a), |6) G H'^, it is an easy task to decide unambiguously 
which vector has larger norm than the other (one can compare the rational 
numbers || |a)|p and || |6)|p, for example). 



Lemma 2.3.8 (Algorithm for £-t-halting-Property of Balls) 

There exists a (classical) algorithm B which, on input \lp) G H^, 5, £ G Q"*", 
i G N and a classical description sm £ {0, 1}* of a fixed-length QTM M , 
always halts and returns either or 1 under the following constraints: 

• If Us{\(p)) is not e-t-halting for M, then the output must be 0. 

• If Us{\ip)) is j-t-halting for M, then the output must be 1. 



Proof. The algorithm B computes a set of vectors {\(Pk)}k=i ^ such 
that for every vector | w) G Us{\(p)) Ci Sn there is a A: G {1, ... , A^} such that 

II \^k) - IV') II < M ^' ^^^^ ^^^^^ (^•®- d^^* {Usilf}) n Sn, lipk)) < 

for every k). 

For every k e {1, . . . , N}, the algorithm simulates the QTM M on input 
\(pk) classically for t time steps and computes an approximation a{t') of the 
quantity {qf\M(~,{\(pk) {(pk\)\Qf) for every t' < t, such that 

/ 3 
a{t') - {qf\M*c{\^k){fk\)\qf) < ^ e for every t' <t. 
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How can this be achieved? Since the number of time steps t is finite, time 
evolution will be restricted to a finite subspace Ti^ C corresponding to 
a finite number of tape cells, which also restricts the state space of the head 
(that points on tape cells) to a finite subspace Tin- Thus, it is possible to give 
a matrix representation of the time evolution operator Vm on 7ic®T~iT®T~iti^ 
and the expression given above can be numerically calculated just by matrix 
multiplication and subsequent numerical computation of the partial trace. 

Every that satisfies \a{t') — < | £ for every t' <t will be marked 
as "approximately halting". If there is at least one \ipk) that is approximately 
halting, B shall halt and output 1, otherwise it shall halt and output 0. 

To see that this algorithm works as claimed, suppose that Us{\(p)) is not 
e-t-halting for M, so for every |^) E Us{\(p)) there is some t' < t such that 

5t't — (^/|^c(lV')(^l)k/) > ^- Also, for every A; € {1, ... , N}, there is some 



vector 



G Us{\ip)) n Sn with II \Lpk) 



A, 



> 



6t't-{qf\M'ci\^k){^k\)\qf) 
5t't-{qf\M'cm{mQf) 
{qflM'cmmQf) - {Qf\MM){^l\)\qf) 
{qf\MU\^k){^k\)\qf) - {qf\M'M){^l\)\qj) 



> 


£ — 




> 


£ — 


\\m- 


> 


£ — 


3 






64^- 



,0\/,„0| 



lTr-2 - |l- |||v3fc)f 

pl)\\-2\l-\\\^k)\\\{l + \\\Vk) 

\vk) - I'pDW -4- —£ > —£ , 



where we have used Lemma lA.41 and Lemma I A. 6 1 Thus, for every k it holds 



\a{t') - St't\ 



> A, 



{qf\M'ci\^k){Vk\)\qf)-a{t'] 



23 3 5 

> £ £ = -£ 

32 32 8 



which makes the algorithm halt and output 0. 

On the other hand, suppose that Us{\ip)) is |-i-halting for M, i.e. there 

which is f-t-halting for M. By construction. 



is some lip) G Us{\(p)) D S,^ 
there is some k such that \\\(pk 

5t't - {qf\M^ci\'Pk){^k\)\qf) < for every t' < t, so \a{t') - 6t 



4 
< 



yields 



32 ^ ^ 32 ^ 



£, and the algorithm outputs 1. 



£• A similar calculation as above 

o4 

< 
□ 
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Lemma 2.3.9 (Algorithm I for Interpolating Subspace) 

There exists a (classical) algorithm I which, on input M,N G N, 
. . . , |(^M>, Wi): \^n) en^, de'N,Q+ B A> 5 andQ+ B A>S, 
always halts and returns the description of a pair (i, U) with i G {0, 1} and 
U C "Hn 0- linear subspace, under the following constraints: 

• // the output is (1, U), then U C Tin rnust he a subspace of dimension 
dimC/ = d such that dist(C/, |<^a:)) < A for every k and dist(C/, |(^/)) > 
6 for every I. 

• // there exists a subspace U C TCn of dimension dim U = d such that 
dist{U, \ipk)) < 6 for every k and dist(f7, |(^/)) > A for every I, then 
the output must be of the^form {1,U). 

The description of the subspace U is a list of linearly independent vectors 

{\i^i)}ticn2nu. 



Proof. Proving this lemma is a routine (but lengthy) exercise. The idea 
is to construct an algorithm that looks for such a subspace by brute force, 
that is, by discretizing the set of all subspaces within some (good enough) 
accuracy. We omit the details. □ 

We proceed by defining the notion of an approximate halting space. Note 
that the definition depends on the details of the previously defined algo- 
rithms in Lemma 12.3.81 and 12.3.91 (for example, there are always different 
possibilities to compute the necessary discretizations). Thus, we fix a con- 
crete instance of all those algorithms for the rest of the paper. 

Definition 2.3.10 (Approximate Halting Spaces) 

We defin^ the 6 -approximate halting space n^M^\t) C Hn and the 5- 
approximate halting accuracy s^^j'^\t) G Q as the outputs of the following 
classical algorithm on input n,tGN, 0<5gQ and sm G {0,1}*, where 
sm is a classical description of a fixed-length QTM M: 

(1) Let E := 18 5. 

(2) Compute a covering of Sn of open balls of radius 5, that is, a set of 
vectors {|Vi), . . . , IV'l)} C (L e N) with \\\i^k)\\ G (1-1,1 + 1) 
for every A; G {1, . . . ,L} such that Sn C Ui^i ^sili^i))- 

''U will then be an approximation of U. 

''From a formal point of view, the notation should rather read Tii"/' (t) instead of 
Ti,^^j^\t), since this space depends also on the choice of the classical description sm of M. 
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(3) For every k G {1,...,L}, compute B{\7pk),S,e,t,SM) o-nd 

18 (5, t, SAf ); where B is the algorithm for testing the e-t- 
halting property of balls of Lemma \2.3.8[ If the output is for every 
k, then output ({0},e) and halt. Otherwise set for Nq B N < L and 

:= {m \ B{\i^k),S,e,t,SM) = l}, 
{\'Pi)}Zi ■■= ili^k) I B{\i;k),6,l85,t,SM) = 0}- 

If N = 0, i.e. if the set {\ipi)}^i is empty, output ({0},e) and halt. 

(4) Set d := 2". 

(5) Let A := 25, A := |(5 and 5 := |(5. Use the algorithm I of 
Lemma \2. 3.9\ to search for an interpolating subspace, i.e., compute 
I{K,N,\(fi),. . . ,\ipK),\^i), - ■ ■ ,\VN),d,A,6,A,6). If the output of I 

is {1,U), output '^'^^ halt. 

(6) Set d := d—1. If d> 1, then go back to step (5). 

(7) Set e := I and go back to step (3). 
Moreover, let H'{^/\t) := ni/\t) n Sn- 

The following theorem proves that this definition makes sense: 



Theorem 2.3.11 The algorithm in Definition \2.3.lOl always terminates on 
any input; thus, the approximate halting spaces 'H^f}'^\t) are well-defined. 



Proof. Define the function Emin 
inf{e > I \ip) is e-t-halting for M}. Lemma lA.41 and IA.6I yield 

(|V'2))| < lll^i) -|V'2)|| , (2.12) 

so Smin IS continuous. For the special case H^^\t) = 0, it must thus hold that 
£miniSn) ■= min|,/,)e5„ £mini\ip)) > 0. If the algorithm has run long enough 
such that e < emin{Sn), it must then be true that -6(1-0^)) £, t, sm) = for 
every k S {1,...,L}, since all the balls Us{\tpk)) are not e-t-halting. This 
makes the algorithm halt in step (3). 

Now consider the case H^^\t) ^ 0. The continuous function £min 
attains a minimum on every compact set C/^d-^fc)) H 5„, so let '■= 
™in|V>ec7«(|Vfc»n5„ ^min{\i^)) {1 < k < N). If = for every fc, then for 
every k and e > 0, there is some vector \tp) £ Us{\^pk)) ^ Sn which is e-t- 
halting for M, so B{\'>pk),S,e,t, sm) = 1 for every e > 0, and so K = in 
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step (3). Thus, the algorithm / will by construction find the interpolating 
subspace U = (C^) and cause halting in step (5). 

Otherwise, let Eq := mm{ek \ k £ {1, . . . , N},ek > 0}. Suppose that 
the algorithm has run long enough such that e < Eq. By construction of 
the algorithm B, if B{\^pk),6,e,t,SM) = 1, it follows that Us{\ipk)) is e- 
t-halting for M, but then, Sk < £ < £o, so Sk = 0, so there is some 
\Tp) G Us{\ipk)) n Sn which is 0-i-halting for M, so dist{n^^\t),\ipk)) < 5. 
On the other hand, if B{\ipk) , S,l85,t, sm) = 0, it follows that Usd^Jk)) 
is not (|(5)-t-halting for M. Thus, dist IV'")) > |(5 according 

to (|2.12p . so dist{Tl^^\t) n Smltpk)) > 45, and by elementary estima- 
tions dist(7i^j^^(t), l^/^fc)) > j6. By definition of the algorithm /, it fol- 
lows that I{K,N,\ifi), . . . ,\(Pk),\'^i)^ ■ ■ ■ A^N),d,A,5,A,6) = {1,U) for 
d := dimWSj^(t) > 1 and some subspace U C Tin, which makes the al- 
gorithm halt in step (5). □ 

We are now going to show some properties of the approximate halting 
spaces. These properties show that these spaces are, in some sense, good 
approximation of a QTM's "true" halting spaces. 



Theorem 2.3.12 (Properties of Approximate Halting Spaces) 

The approximate halting spaces TL^^f^^ (t) have the following properties: 

• Almost-Halting: If e H'^/\t), then IV') is {20 6) -t- halting for M . 

• Approximation: For every S H^ji^\t), there is a vector l?/'^^^) S 
H^M^\t) which satisfies \\ IV') - < ^S. 

• Similarity: If 6, A G Q"*" such that 6 < ^£^m^^(^)> then for every 

S H^^'^\t) there is a vector G H^^^'^\t) which satisfies 

• Almost-Orthogonality: // IV't) S H^M^\t) and \ipt') G H'^/\t') for 
t / t', then it holds that \{tpt\i^t')\ < 4\/55. 



Proof. Assume that H^^'^'it) / 0. Let |V') G H^}^ '{t) C 5„, and let 
(IV'i), • • • , IV'l)} C Ti-n be the covering of 5„ from the algorithm in Defini- 
tion [2?3]ini By construction, there is some k £ {1, . . . ,L} such that S 
Us{\ipk))- The subspace 'H^M^\t) is computed in step (5) of the algorithm 
in Definition l2.3.1Ul via I{K, N, \(pi), ■ ■ ■ , \^k), • • • > Iv^A^); d, A, 6, A, 5) = 
{l,Tl^^j'^\t)), and since dist{Tl^^f^\t),\ipk)) < it follows from the prop- 
erties of the algorithm / in Lemma 12.3.91 that {ipk) I'fl) for every 
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I £ {1, ... , K} in step (3) of the algorithm. Thus, B{\'ipk),S, 18 6, t, sm) = l, 
and it follows from the properties of the algorithm B in Lemma 12.3.81 that 
Us{\ilJk)) is (18 5)-t-halting for M, so there is some G Us(\il)k))^Sn which 
is (18 (5)-t-halting for M. Since || IV') ~ IV') II < 25, the almost-halting property 
follows from Equation (I2.12p . 

To prove the approximation property, assume that H^\t) ^ 0. Let 
IV') G H^^\t) C 5„; again, there is some j G {1,...,L} such that 
G Us{\ipj)), so Usili^j)) is 0-t-halting for M, and B{\il)j),6,e,t, sm) = 

I for every e > by definition of the algorithm B. For step (3) of 
the algorithm in Definition 12.3.101 it thus always holds that {tpj) G 
{\'Pi)}iLi- The output of the algorithm is computed in step (5) via 
I{K,N,\ip,),...,\^K),\^i),...,\y^N),d,A,S,A,6) = {l,nf/\t)). By def- 
inition of /, it holds dist{7{^]!^^'^\t),\'ijjj)) < A, and by elementary estima- 
tions it follows that dist(?^j^/''^(^) n 5^, IV'j)) < | + 2A, so there IS some 

IV'(^)) G Hi^'^\t) such that || IV'^^^) - iV'j) II < | + 2A. Since || |V')-|V'j)ll < ^ 
and A = 26, the approximation property follows. 

Notice that under the assumptions given in the statement of the sim- 
ilarity property, it follows from the almost-halting property that if |V') £ 
H^'^\t), then 1-0) must be |ej^'^'* (t)-t-halting for M. Consider the com- 
putation of 'H^^j'^\t) by the algorithm in Definition 12.3.1(11 By construc- 
tion, it always holds that the parameter e during the computation satisfies 
e > £m''^''(*)) so \tP) is always |-t-halting for M, and if G Usdipj)), it 
follows that B{\ijjj),5,e,t,SM) = 1- The rest follows in complete analogy to 
the proof of the approximation property. 

For the almost-orthogonality property, suppose \v) G H^^j'^\t') and 

\w) G H^'^\t) are two arbitrary qubit strings of length n with dif- 
ferent approximate halting times t < G N. There is some I G 
{1,...,L} such that \w) G Usi\tpi)), so dist{n^^'^\t) , < 6 < 6. Since 
I{K,N,\ipi), . . . ,\ipK),\^i), ■ ■ ■ ,\VN),d,A,6,A,6) = {l,n'l/\t)) at step 
(5) of the computation of Tl^^j'^\t), it follows from the definition of / that 
there is no m G N such that \ipi) = {ffm) for the sets defined in step (3) 
of the algorithm above. Thus, B {\ipi), 6, 18 5, t, sm) = 1, and by definition 
of B it follows that Us{\tpi)) must be (18 (5)-i-halting for M, so there is 
some vector \ijj) G Us{'iIji)) H Sn which is (18 5)-t-halting for M and satisfies 

II 1'"^) ~ l'"^)ll ^ II l'^) ~ IV'«)II + II iV'i) ~ |w^)ll < 2<5. Analogously, there is some 
vector \v) G Sn which is (18 (5)-t'-halting for M and satisfies || |f ) — |v) || < 25. 

From the definition of the trace distance for pure states (see [301 (9.99)] 
and of the e-f-halting property in Definition 12. 3. 7l together with Lemma [A. 41 
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and Lemma lA.61 it follows that 

Y^l - \{w\v)\'^ = 
> 

> 

> 

This proves the almost-orthogonality property. □ 

The following corollary proves that the approximate halting spaces 
1-6^^* (t) are "not too large" if S is small enough. Formally, we will need this 
property to prove the Kraft inequality for some code in Subsection 12.3.41 
as well as for some estimation in Section 13.41 on the quantum complexity of 
classical strings. 



Corollary 2.3.13 (Dimension Bound for Halting Spaces) 

If6< 8^2"^"; then^dimn^^'^\t) < 2". 



Proof. Suppose that XlteN *^™^m ''^(^) > 2". Then, choose orthonor- 
mal bases in each of the spaces Ti.^^j'^\t), and let {\(pi)}f^'l^ be the union of 
the first 2" + 1 of these basis vectors. By construction and by the almost- 
orthogonality property of Theorem 1 2. 3.121 it follows that < 4\/5^ < 
~ (2"+\)-i ^'^^ every i j. Lemma I A. 2 1 vields dimC/ > 2" + 1 for 
U := span 

{\'Pi)}flt'^ C Tin, but dimHn = 2", which is a contradiction. □ 

2.3.3 Compression, Decompression, and Coding 

In this subsection, we define some compression and coding algorithms that 
will be used in the construction of the strongly universal QTM. 

Definition 2.3.14 (Standard (De-) Compression) 

Let U C TCn be a linear subspace with N := dimf/. Let Pu € B{TCn) be the 
orthogonal projector onto U, and let {\ei)}f^^ be the computational basis of 
Tin- The result of applying the Gram-Schmidt orthonormalization procedure 
to the vectors = {Pu\^i)}'i=i (dropping every null vector) is called 

the standard basis {\ui) , . . . ,\un)} of U. Let \fi) be the i-th computational 
basis vector of TC^iogN]- The standard compression Cu : U ^ T~(-l\ogN] is 
then defined by linear extension of Cu{\ui)) := \fi) for 1 < i < N , that 



II \'w){w\ — \v){v\ Wtt 

II \w){w\ — \v){v\ \\tt — II |it')(u'| — |^Z;)(^Z;|| Utt 
- II \v){v\ - \v){v\ Wtv 

\{qf\M'c{\w){w\)\qf) - {qf\M'c{\v) {v\)\qf)\ 
-II \w) - \w)\\ - II \v) - \v)\\ 

1 - 36 5 - 2(5 - 2(5 = 1 - 40 (5. (2.13) 
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is, Cfj isometrically embeds U into 'H\^\ogN^- A linear isometric map Vu : 
"^[logAf] ~^ will he called a standard decompression if it holds that 

Vu o Cu = lu ■ 

It is clear that there exists a classical algorithm that, given a description of U 
(e.g. a list of basis vectors C Tl^), can effectively compute (clas- 

sically) an approximate description of the standard basis of U. Moreover, 
a quantum Turing machine can effectively apply a standard decompression 
map to its input: 



Lemma 2.3.15 (Q-Standard Decompression Algorithm) 

There is a QTM D which, given a descriptiot^of a subspace U C Tin, ihe 
integer n G N, some 6 G , and a quantum state \^jJ) G W|-iogdimr/] ; outputs 
some state \ip) S Tin with the property that \\ \ip) — Vif\tp)\\ < 6, where Vu 
is some standard decompression map. 



Proof. Consider the map A : 'H|-iogdim!7] ~^ '^n, given by A\v) := 
|Q^(gi(n-[iogdimC/]) (g, |^^^ The map A prepends zeroes to a vector; it maps 
the computational basis vectors of Ti piog dim u] to the lexicographically first 
computational basis vectors oiTCn- The QTM 2) starts by applying this map 

A to the input state \^) by prepending zeroes on its tape, creating a state 
1^) := |o)®('^-riogdimC/l) ^ g 

Afterwards, it applies (classically) the Gram-Schmidt orthonormaliza- 
tion procedure to the list of vectors {Itti), • • • , \udimu), l^i), • • • , |e2")} C Ti^, 
where the vectors {\ui)}f}^^ are the basis vectors of U given in the input, 
and the vectors {|ej)}?^^ are the computational basis vectors oiTin- Since ev- 
ery vector has rational entries (i.e. is an element of W^), the Gram-Schmidt 
procedure can be applied exactly, resulting in a list {\ui)}fl^ of basis vectors 
of Tin which have entries that are square roots of rational numbers. Note 
that by construction, the vectors (luj)}^™^ are the standard basis vectors 
of U that have been defined in Definition 12.3.141 

Let V be the unitary 2" x 2"-matrix that has the vectors as 
its column vectors. The algorithm continues by computing a rational ap- 
proximation V oiV such that the entries satisfy | Vij — ViA < 



^ 2"+i(10V2")2" ' 

and thus, in operator norm, it holds ||t^ — < 2(10^^)^" ' I^^^'^stein and 
Vazirani Sec. 6] have shown that there are QTMs that can carry out 
an e-approximation of a desired unitary transformation V on their tapes 
if given a matrix V as input that is within distance 2(10^)^ d x d- 



'(a list of linearly independent vectors • . • , IttdimC/)} C U 11 H^) 
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matrix V. This is exactly the case her^, with (i = 2" and e = 6, so let 
the D apply V within 6 on its tape to create the state \(p) £ Tin with 
II Iv?) - V\ip)\\ = \\\ip) - V o A\ip)\\ < 6. Note that the map F o A is a stan- 
dard decompression map (as defined in Definition I2.3.14p . since for every 
i G {1, . . . , dim [/} it holds that 

VoAo Cu\ui) = V o A\fi) = V\e,) = \ui) , 

where the vectors \ fi) are the computational basis vectors of Wi-iogdimf/] ■ ^ 

The next lemma will be useful for coding the "classical part" of a halting 
qubit string. The "which subspace" information will be coded into a classical 
string Ci G {0, 1}* whose length £i G Nq depends on the dimension of the 
corresponding halting space Ti.^^'^\ti). The dimensions of the halting spaces 
(^diniTC^^'^\ti) , dimTl^^j'^\t2) , ■ ■ can be computed one after the other, but 
the complete list of the code word lengths £i is not computable due to the 
undecidability of the halting problem. Since most well-known prefix codes 
(like Huffman code, see start by initially sorting the code word lengths 
in decreasing order, and thus require complete knowledge of the whole list 
of code word lengths in advance, they are not suitable for our purpose. We 
thus give an easy algorithm that constructs the code words one after the 
other, such that code word q depends only on the previously given lengths 
£i,i2, . . . We call this "blind prefix coding", because code words are 
assigned sequentially without looking at what is coming next. 



Lemma 2.3.16 (Blind Prefix Coding) 

Let {(i}iLi C No 6e a sequence of natural numbers (code word lengths) that 

N 

satisfies the Kraft inequality 2~^* < 1. Then the following ("blind pre- 

i=l 

fix coding") algorithm produces a list of code words {ci}^^ C {0,1}* with 
£{ci) = £i, such that the i-th code word only depends on £i and the previously 
chosen codewords ci, . . . , Ci-i: 

• Start with ci := 0^^, i.e. ci is the string consisting of £i zeroes; 

• for i = 2, . . . , N recursively, let Ci be the first string in lexicographical 
order of length £{ci) = £i that is no prefix or extension of any of the 
previously assigned code words ci, . . . , Q-i. 



Proof. We omit the lengthy, but simple proof; it is based on identifying 
the binary code words with subintervals of [0, 1) as explained in [23|. We also 

®Note that we consider Ttn as a subspace of an n-cell tape segment Hilbert space 
, and we demand V to leave blanks l^^) invariant. 
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remark that the content of this lemma is given in [11^ Thm. 5.2.1] without 
proof as an example for a prefix code. □ 



2.3.4 Proof of the Strong Universality Property 

To simplify the proof of Main Theorem l2.2.H we show now that it is sufficient 
to consider fixed-length QTMs only: 



Lemma 2.3.17 (Fixed-Length QTMs are Sufficient) 

For every QTM M, there is a fixed-length QTM M such that for every 
p G (H^Q iy*) there is a fixed-length quhit string p G UnsNo •^^^c/i 
that M{p) = M{p) and l{p) < £{p) + 1. 



Proof. Since dim'H<„ = 2"'~^^ — 1, there is an isometric embedding of 
7i<n into Ttn+i- One example is the map Vn, which is defined as Vn\ei) := \ fi) 
for i G {1, . . . , 2"+^ — 1}, where |ej) and \ fi) denote the computational basis 
vectors (in lexicographical order) of 7i<n and Tin+i respectively. As Ti-n+i C 
?^<(„_l_i) and Ti.<n C 'H<(.„+i), we can extend Vn to a unitary transformation 
Un on 'H<(„_|_i), mapping computational basis vectors to computational basis 
vectors. 

The fixed-length QTM M works as follows, given some fixed-length qubit 
string p G T^{Tln+i) on its input tape: first, it determines n + 1 = £{p) by 
detecting the first blank symbol ^. Afterwards, it computes a description 
of the unitary transformation U* and applies it to the qubit string p by 
permuting the computational basis vectors in the (n + l)-block of cells cor- 
responding to the Hilbert space 

M to continue the computation on input p := U* pUn- If M halts, then the 
output will be M{p). □ 

Proof of Theorem 12.2.11 First, we show how the input aM for the 
strongly universal QTM il is constructed from the input a for M. Fix some 
QTM M and input length n G Nq, and let Eq := 2"^". Define the halt- 
ing time sequence {t^M {i)}iLi as the set of all integers t G N such that 
dimn^^j''°\t) > 1, ordered such that t^^ii) < t^^\i + 1) for every i. The 
number N is in general not computable, but must be somewhere between 
and 2" due to Corollary EXH 

For every i G {1, . . . , A^}, define the code word length £{^^'"'^ as 



l) .= n + 1 



logdimWlr^ 
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This sequence of code word lengths satisfies the Kraft inequahty: 



i=l i=l 

N 



< 2-"^dim<'-)(4^)« 

i=l 

= 2-"^dimWS^'^«)(t)<l, 



where in the last inequality, Corollary 12.3.131 has been used. Let 
I ^ -j^i* ^j^g blind prefix code corresponding to the sequence 

l^-'^'"''! which has been constructed in Lemma 12.3.161 

In the following, we use the space as some kind of "reference 

space" i.e. we construct our QTM il such that it expects the standard com- 
pression of states lip) S TL^^/'^'^\t) as part of the input. If the desired accuracy 
parameter 6 is smaller than eq, then some "fine-tuning" must take place, 
unitarily mapping the state \ip) G '^^"'^''^(i) into halting spaces of smaller 
accuracy parameter. In the next paragraph, these unitary transformations 
are constructed. 

Recursively, for A; G N, define Sk := gn^M^''"^''^*)- Since e'}^j^\t) < 186 
by construction of the algorithm in Definition 12.3. lU"t we have < {^)^ ■ 

0. It follows from the approximation property of Theorem 12.3.121 
together with Lemma lA.51 that dim'Hj^"'^''^(t) > dimTl^jl^\t) . The similarity 
property and Lemma [Aj tell us that dimWjj'^'=-'^(t) > dimWSj'^'=^(t) for 

every A; G N, and there exist isometrics Uk ■ H^^'^''\t) 7i^^'^''~^\t) that, 
for k large enough, satisfy 

8 /n /5\^ /18\2 



Let now d := limfc^oo dim7^^'^''^(t) and c : = 

mm {A;GN I dimn^;}'"'\t) = dy For any choice of the transformations Uk 
(they are not unique), let 

-yin^e,)... ._ / Uk+iUk+2 ■ . . UMti'^Ht) if A: < c , 

^ ^^-~\ n^M'''\t) ifk>C. 

It follows that the spaces n'-M^'ht) all have the same dimension for every 
k £ No, and that C n^^j^''\t). Define the unitary operators Uk '■= 
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Uk \ n^M''\i)^ then \\U* - 1|| < \\Uk - 1||, and so the sum J2T=i - 1|| 
converges. Due to Lemma El the product U := JI^i 

converges to an 

isometry U : 'H^^j^°\t) — > Tin- It follows from the approximation property 
in Theorem 12.3.121 that Ti.^^^ {t) C ran({7), so we can define a unitary map 

[/-I : ran(C/) ^ ni''''\t) by U'^Ux) := x, and C dom([/-i). 

Due to Lemma 12.3.171 it is sufficient to consider fixed-length QTMs 
M only, so we can assume that our input o" is a fixed-length qubit string. 
Suppose M((t) is defined, and let r G N be the corresponding halting time for 
M. Assume for the moment that a = \'ip){ip\ is a pure state, so lip) G H^^^ {t). 
Recall the definition of the halting time sequence; it follows that there is 
some z G N such that r = t^^^{i). Let 

that is, the blind prefix code of the halting number i, followed by the stan- 
dard compression (as constructed in Definition 12.3. 14|) of some approxima- 
tion [/-^IV') of IV') that is in the subspace 'H^'^"^(r). Note that 



logdim?^i"''°)(T) 



n+ 1 . 



If fj = Afc|'(/'fc)(V'fc| is a mixed fixed-length qubit string which is r-halting 
for M, every convex component \ipk) must also be r-halting for M, and it 
makes sense to define a^^'^^ := | V'^*^'"^ ) (V'i^'"'' I > where every IV'l;^'"^) 

(and thus o"^^'"^) starts with the same classical code word ci^'^\ and still 

The strongly universal QTM il expects input of the form 

SM®fT(^'"\<5) =: {cjM,5) , (2.15) 

where sa/ G {0, 1}* is a self-delimiting description of the QTM M. We will 
now give a description of how il works; meanwhile, we will always assume 
that the input is of the expected form (|2.15|) and also that the input cr is a 
pure qubit string |V')(V'I (we discuss the case of mixed input qubit strings a 
afterwards): 

• Read the parameter 5 and the description sm- 

• Look for the first blank symbol # on the tape to determine the length 
£((j(^.")) =n + l. 

• Compute the halting time r. This is achieved as follows: 



(1) Set t := 1 and i := 0. 
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(2) Compute a description of r6^''''\t). If dim = 0, then 
go to step (5). 

(3) Set i := i + 1 and set 4^'"^ := 



n + 1 



logdimWi7°) (t) 



the previously computed code word lengths ^ 



(M,n) 



. From 



(M,n) 



compute the corresponding blind prefix code word c\ . Bit by 

bit, compare the code word c\^'^'^'^ with the prefix of cr^*^'"^. As 
soon as any difference is detected, go to step (5). 

(4) The halting time is r := t. Exit. 

(5) Set t -.= 1 + 1 and go back to step (2). 

Let IVJ) be the rest of the input, i.e. a^^^'") =: |cS*^'"^)(4^'''^| ® 

(up to a phase, this means that = C iu.eq), ,U~^\ip)). Apply the 

quantum standard decompression algorithm D given in Lemma [2.3.15l 

Then, 



i.e. compute \(p) := T) (W^"'^""* 



n 



\^) - u- 



5 

<3 



Compute an approximation V : Tin 



with 



u-v \n 



M ^ 



< 



5/3 



2(10V2") 



Tin of a unitary extension of U 
rrr =: e, where U is some "fine- 



tuning map" as constructed above. This can be achieved as follows: 

- 

- Choose N eN large enough such that YlT=N+i const„- (||) ^ < - 



2' 



where const„ G M is the constant defined in Equation (|2.14|) . 
— For every k G {1,...,A^}, find matrices : Tin T~(-n that 



approximate the forementionecl^ isometrics Uk ■ 



n,{n,ek-i) 



(t) such that 



N 



N 



j(",eo) 



it) 



k=l 



k=l 



e 

<2 



Setting V := HfeLi ^^^^ work as desired, since 



N 



k=l 



u 



< 



< 



CO 

E 

k=N+l 



\\Uk 



constn 

fc=7V+l 

due to Equation (I2.14p and the proof of Lemma IA.3[ 



< 



^The isometries Uk are not unique, so they can be chosen arbitrarily, except for the 
requirement that Equation (|2.14p is satisfied, and that every Uk depends only on Ti^v" (i) 



and Ti. 



(n,£fc_i) 



(t) and not on other parameters. 
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Use V to carry out a g-approximation of a unitary extension U ofU on 
the state \ip) on the tape (the reason why this is possible is explained 
in the proof of Lemma l2.3.15p . This results in a vector \ip) with the 
property that || \ip) - U\'f)\\ < ^ 



3- 



• Simulate M on input |<^)(¥'| for r time steps within an accuracy 
of |, that is, compute an output track state po £ T^{Ti.o) with 

IIpo — -^o(IV')(¥'l)llTr ^ i' this state to the own output track 

and halt. (It has been shown by Bernstein and Vazirani in [1] that 
there are QTMs that can do a simulation in this way.) 

Let (Tm := sm ® a^^'"'\ Using the contractivity of the trace distance with 
respect to quantum operations and Lemma lA. 41 we get 

\\ii{aM,s) - MmmWr = mpo)-n{M^m{m\\Tr 

< ||po-MS(|v5)(95|)||Tr 



+ \\M^{\^){^\)-MS 
6 
3 



Tr 



< o + lll'^)(^|-|V')(V'lllTr 



< ^ + |||^)-[7|^)|| + ||f7|.^) 



\^)-u*\^P) 



< 6 . 



This proves the claim for pure inputs a = \ip){ip\. If cr = J2k '^k\'^k){ipk\ is 
a mixed qubit string as explained right before Equation (I2.15p . the result 
just proved holds for every convex component of a by the linearity of M, 
i.e. \\pk — ^i\'4'k){'4'k\)\\T[ < the assertion of the theorem follows from 

the joint convexity of the trace distance and the observation that il takes 
the same number of time steps for every convex component \^l^k){'^k\■ ^ 

This proof relies on the existence of a universal QTM U in the sense of 
Bernstein and Vazirani as given in Equation ()2.7p . Nevertheless, the proof 
does not imply that every QTM that satisfies (|2.7p is automatically strongly 
universal in the sense of Theorem I2.2.1t for example, we can construct a 
QTM U that always halts after T simulated steps of computation on input 
{sm,T,5, and that does not halt at all if the input is not of this form. 
So formally, 

{U QTM universal by ([2771) } 2 QTM strongly universal}. 

We are now going to sketch the proof of Proposition 12.2.21 and the proof 
idea of Conjecture 12.2.31 The reason why we do not give the full proof is 
that this full proof would consist by a large part only of certain analytic 
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estimates that show to what accuracy the universal QTM il should do its 
calculations. This would be a very long proof, consisting of many routine 
calculations which are not very helpful for a reader. 

Remember the proof of Theorem 12. 2. 1[ The proof idea was to let the uni- 
versal QTM U compute approximations of the halting spaces of the other 
QTM M and use this information to "uncompress" some cleverly chosen 
input and simulate M in a classically controlled manner. The subsequent 
lengthy proof showed that the UQTM il was really able to approximate 
these halting spaces well enough to make the proof idea work. This had to 
be worked out in detail at least once for this special situation, to be sure that 
there are no subtle difficulties inherent to the computable approximations. 
Nevertheless, since every map and structure that we encountered was con- 
tinuous and finite-dimensional, it is not so surprising that everything worked 
fine. 

Consequently, we will now only sketch the proof of Proposition [?.2. 21 and 
the proof idea of Theorem 12.2.31 by only specifying what kind of structures 
(analogues of the halting spaces) il is supposed to approximate, but without 
specifying in detail to what accuracy il should do its approximations. 

Both proof sketches that follow are based on the idea that a QTM which 
is universal in the sense of Bernstein and Vazirani (i.e. as in Equation (|2.7p ) 
has a dense set of unitaries that it can apply exactly. We can call such 
unitaries on Tin for n G N ii- exact unitaries. 

This follows from the result by Bernstein and Vazirani that the corre- 
sponding UQTM U can apply a unitary map U on its tapes within any 
desired accuracy, if it is given a description of U as input. It does so by de- 
composing U into simple ( "near-trivial" ) unitaries that it can apply directly 
(and thus exactly). 

We can also call an n-block projector P £ B{7in) il-exact if it has 
some spectral decomposition P = \^pi){■^pi\ such that there is a il-exact 
unitary that maps each {tpi) to some computational basis vector of Tin- If 
P and 1 — P are il-exact projectors on Tin, then il can do something like 
a "yes-no-measurement" according to P and 1 — P: it can decide whether 
some vector \ip) € Tin on its tape is an element of ranP or of (ranP)-*- 
with certainty (if either one of the two cases is true), just by applying the 
corresponding il-exact unitary, and then by deciding whether the result is 
some computational basis vector or another. 

Proof Sketch of Proposition I2.2.2L In analogy to Definition 12.3. H 
we can define halting spaces H^^j {ti,t2, • • • , tj) as the linear span of 

Hff{ti,t2, . . .,tj) := {|^) G Tin I (|V')(V'l,i) is ti-halting for M {1 < i < j)}. 

Again, we have (^(ti)i^-^^ _L W^""* (^{t[)i^^^ if t 7^ t' , and now it also holds 
that 7{^^^{ti, . . . ,tj,tj^i) C T6^j{ti, ■ ■ ■ ,tj) for every j € N. Moreover, we 
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can define certain ^-approximations Tir^j [ti, . . . ,tj). We will not get into 
detail; we will just claim that such a definition can be found in a way such 
that these (^-approximations share enough properties with their counterparts 
from Definition 12.3.101 to make the algorithm given below work. 

We are now going to describe how a machine il with the properties 
given in the assertion of the proposition works. It expects input of the form 
(fc, / O SM O 0-^*^'"^), where / e {0,1} is a single bit, sm G {0,1}* is a 
self-dehmiting description of the QTM M, cr(^^'") e CH^o,!}*) is a qubit 
string, and A; S N an arbitrary integer. For the same reasons as in the 
proof of Theorem 12.2.11 we may without loss of generality assume that the 
input is a pure qubit string, so cj^*^'"^ = Moreover, due to 

Lemma 12.3.171 we may also assume that M is a fixed-length QTM, and so 
criM,n) g r^(Un) is a fixed-length qubit string. 

These are the steps that il performs: 

(1) Read the first bit / of the input. If it is a 0, then proceed with the rest 
of the input the same way as the QTM that is given in Theorem 12. 2. II 
If it is a 1, then proceed with the next step. 

(2) Read sm, read A;, and look for the first blank symbol # to determine 
the length n := ^(cr^*^-")). 

(3) Set j := 1 and 6o G (depending on n) small enough. 

(4) Set t := 1. 

(5) Compute 'H^'^°^(ri, . . . , rj_i, t). Find a il-exact projector 
P^\ti, . . . , rj_i, t) with the following properties: 

. Pif (n , . . . , r,_i , f) • 4f ^ (ri , . . . , r,_i , t) = for every l<t' <t, 
. Pl;')(ri,...,r,_i,t)<p|?(ri,...,r,_i), 

• the support of p|"^(ri, . . . , rj_i, t) is close enough to 

wif«)(n,...,r,_i,t).' 

(6) Make a measuremenl|f| described by P^\ti, . . . ,rj_i,t). If is 

an element of the support of P^\ti, . . . , rj_i, i), then set tj := t and 
go to step (7). Otherwise, if is an element of the orthogonal 

complement of the support, set t := t + 1 and go back to step (5). 

(7) If j < 2k, then set j := j + 1 and go back to step (4). 

*It is not really a measurement, but rattier some unitary branciiing: if l-i/i'*^'"^) is some 
superposition in between botli subspaces W := supp (^Pi"\Ti, . . . , r_,_i, t)^ and W''', then 
the QTM will do both possible steps in superposition. 
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(8) Use a unitary transformation V (similar to the transformation V from 
the proof of Theorem 12.2. ip to do some "fine-tuning" on I'i/;^*^'")), 
i.e. to transform it closer (depending on the parameter k) to some 
space (ri, . . . , Tj) D H^^^ (ri, . . . , Tj) containing the exactly halting 
vectors. Call the resulting vector jt/i^^'")) := U|V'(*^'")). 

(9) Simulate M on input (^2k, for T2k time steps within 
some accuracy that is good enough, depending on k. 

Let 'H^^'^'^\ti, . . . ,tj) be the support of P^\ti, . . . ,tj). These spaces 
(which are computed by the algorithm) have the properties 

{{u)U) ^ {(tdQ if t / 1', 

which are the same as those of the exact halting spaces Tl^^\ti, . . . ,tj). If all 
the approximations are good enough, then for every 1-0) € H^^\ti, . . . ,tj) 
there wih be a vector |^(*'^'")) G n''^/°\ti, . . . ,tj) such that \\\tl;) - 
is smah. If this j-i/'^^'^'")) is given to il as input together with 
all the additional information explained above, then this algorithm will un- 
ambiguously find out by measurement with respect to the il-exact projectors 
that it computes in step (5) what the halting time of 1-0) is, and the simula- 
tion of M will halt after the correct number of time steps with probability 
one and an output which is close to the true output M{2k,a). □ 



Proof Idea for Conjecture 12.2.31 The first difficulty that arises in 
considering average length £ instead of base length i is that it is no more 
sufficient to consider fixed-length QTMs. Moreover, while the pure qubit 
strings {tp) with base length < n are all elements of some (small) 

subspace 7i<n C Wjo,!}* , this is no more true for the qubit strings with 
average length i{\ip)) < n. But to do numerical approximations, we should 
be able to restrict to some finite-dimensional subspace. 

To resolve this difficulty, note that if cr G '^'''(^{o,!}*) is any input qubit 
string which makes a QTM M halt after t time steps, then M cannot have 
read more than t cells of its tape. Thus, it follows that also the restriction 
of a to the first t cells (called a{ and defined on page makes the QTM 
behave completely equivalently: 

a is t-halting for M =^ M{a) = M{a\). 

But if M is a prefix QTM, as in the statement of the theorem that we are 
about to prove, then it must hold that i{a) < t, or equivalently, a = a\, 
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because otherwise, Lemma 12.3.61 would be violated. Thus, 

'Hiviit) C TLKt since M is a prefix QTM. 

Again, we assume that we can define certain computable approximations 
7i^^{t), where e > is some approximation parameter, that approximate 
the true halting spaces TtMit) good enough to make the algorithm that 
follows work. We also assume that the approximate halting spaces Tl^^{t) 

share the property H^^{t) _L 'H^lj{t') for t ^ t' with the true halting spaces 
Ti-Mit) that they approximate. 

Moreover, we want to use the prefix property of M, and demand that 
the approximate halting spaces TL^^ (t) have the prefix property of Defini- 
tion [2331 i.e. if 1-0) G and G TC^m i^') some t,t' eN such that 
£{\ip)) > e{\ij)) =: n, then it holds 

(V'I(I^)(¥'I?)IV')=0. (2.16) 

For the same reason as in the proof of Theorem 12.2.11 (i.e. the number 
of steps that the following algorithm takes depends only on the running 
time of the calculation that it simulates), we may restrict to pure input 
qubit strings. The algorithm that il performs expects input of the form 
{S,sm ® where 6 G Q"*" is the parameter from the state- 

ment of the theorem, sm & {0, 1}* is some description of a QTM M, and 
l^(A^)^ G "^{0,1}* is an arbitrary indeterminate-length qubit string. It pro- 
ceeds as follows: 

(1) Read 5, read sm-, and let t := 1. 

(2) Compute a description of the space T-6^}{t). Find a il-exact projector 
P^^ {t) G B{7{<t) with the following properties: 

• the support 'H^^){t) of P^j {t) is a good approximation of T-6^j{t), 

• (t) • P^ {t') = for every t' < t, i.e. for all previously com- 
puted il-exact projectors, 

• the collection of support subspaces Ut'=i "^m (*') satisfies Equa- 
tion ()2.16p . i.e. is prefix- free. It is not clear if this is easy to 
achieve; this is exactly the point why the statement is just a con- 
jecture, not a theorem. 

(3) Make a measuremenl|£| described by the projectors pj^\t) and 1-H<t — 

Pl^\t), i.e. decide whether IV'^^^^) is an element of i-6^{t) or of its 
orthogonal complement. In the first case, go to step (4). In the second 
case, let i := f + 1 and go to step (2). 

^Again, this is not really a measurement, but rather some unitary branching. 
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(4) Use a unitary transformation V (similar to the transformation V from 
the proof of Theorem I2.2.ip to do some "fine-tuning" on i.e. 
to transform it closer (depending on the parameter 6) to some space 
Ti-Mit) D Ti-Mit) containing the exactly halting vectors. Call the re- 
sulting vector := V\tp^'^^^). 

(5) Simulate the QTM M for t time steps on input move 
the corresponding output to the output track and halt. 

If all the approximations are good enough, then for every \jp) G HM{t) there 
should be a vector j-^^*^)) G w£V) such that || \ip) - V\ip^^^)\\ is small. If 
jg given to the QTM 23 as input together with sm and 5 as shown 
above, then this algorithm will find out by measurement with respect to the 
23-exact projectors given above in step (2) what the corresponding halting 
time is, and the simulation of M will halt after the correct number of time 
steps with probability one. 

Note that the "measurement" in step (3) only works because M is a prefix 

QTM: in the case that IV'^*^)) G T^m (*') for some t' > t and ^dV'^*^))) > i, 
this fact guarantees that the measurement result will always be that 
is in the orthogonal complement of i-6^{t), even though the measurement 
cannot access the state completely. 

It also seems that if sm and 5 are encoded into the input in a clever 
way, then 5J inherits the property of being prefix-free from the QTMs that 
it simulates. But again, this has to be checked in more detail once this proof 
idea will be turned into a complete proof. □ 

2.4 Halting Stability 

In this thesis, we have defined that a QTM halts at some time t according to 
Equation ()2.3p if and only if its control is exactly in the halting state \qf) at 
time t, and exactly orthogonal to the halting state before. We have argued 
in Section 12.21 why this halting definition is useful and natural, at least for 
our purpose to study quantum Kolmogorov complexity. 

Yet, it may first seem that this halting definition is too restrictive, since 
it dismisses every input which halts only approximately, but not perfectly, 
even if it is very close to halting. In this section, we show that this definition 
of halting has some built-in error tolerance that was not expected at the 
beginning: for every input which makes a QTM almost halt, there is another 
input which is at most a constant number of qubits longer, and which makes 
the universal QTM halt perfectly. 

Thus, the definition of halting that we use in this thesis (and that was 
first considered by Bernstein and Vazirani) is not as "unphysical" as it first 
seems, but makes perfect sense. 
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We start by showing that superpositions of almost halting input qubit 
strings are again almost halting. To establish this result, we need some esti- 
mation of a matrix element appearing in the superposition's density matrix. 



Lemma 2.4.1 (Halting Matrix Element) 

Let M be a QTM, let \ip) G W{o,i}* he e-t-halting for M, and let € 
"^{0,1}* be 5-t-halting for M . Then, the operator \(p){ip\ satisfies 



Proof. Let Vm S B{'Hqtm) be the unitary time evolution operator of 
M . Identifying \ip) G Wjo,!}* with the initial state of the QTM M on input 
we write 



for every t' G Nq, where B is an arbitrary orthonormal basis of 7ii®7io®7iii. 
Multiplying and computing the partial trace, we get 



(g/|Mc(|(/?)(V'|)|g/) < ^/s5 for every t' < t, and 



J2 {q\M'ci\^)mQ) < 




(2.17) 



qeQ,beB 



TrionVl',\^){ip\{V^j) 



0^'qb'^t'b\l)i^' 



q£Q,q'eQ,b£B 



By the assumptions of the theorem, it follows 




Similarly, for \^p), we get the inequality 




where the coefficients /3*'^ are defined analogously as in Equation (|2.17|) . Now 
suppose t' < t. Then, we get by the Cauchy-Schwarz inequality 





< Ve5. 



2.4. Halting Stability 



55 



Using the Cauchy-Schwarz inequality again, we get for t' = t 



< 



q&Q-.qy^qf b&B 

/ E El"* " 

V q'^Q-qHf beB 



qb\ 



/ E 

q&Q.q^qf b&B 



beB 



|2 



>l-e 



t |2 



6eB 

>l-5 



The claim follows. 



□ 



Lemma 2.4.2 (Approximate Halting of Superpositions) 

Let M he a QTM, t G N, and C be a set of positive numbers. 

Moreover, let {\^Pi)}^i C Wjo^i}* be a set of normalized vectors, i.e. pure 
qubit strings, such that every \ipi) is Ei-t-halting for M. 

If W) = Yld=i^iWi) normalized, then \lp) is (^2f=i\oii\y/ei^ -t-halting 
for M. 



Proof. Let p := = Sf^=i CK«CKjl'/'j)(¥'il- Using Lemma [2.4.11 we 

get for t' < t 



N 



{qf\M'c{p)\qf) < E iif\Mci\^i){'Pj\)\qf 



N / N \ • 

< ^^\ai\\aj\^/^iy/£'j = \^^\ai\y/e'i\ 

i,j=l \i=l J 



Moreover, for t' = t, we have 

{qf\M'cip)\qf) = 1- E ill^hipM 

q&Q.q^qf 



i,j = l q£Q:g^qf 
N / ^ \ ' 

ij=l \i=l / 
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To prove the result about halting stability, we need another lemma which 
states that almost halting qubit strings with different halting times are al- 
most orthogonal to each other. 



Lemma 2.4.3 (Almost-Orthogonality) Let M he a QTM, and let 
\(p), IV') G "^{0.1}* ^6 normalized pure qubit strings. If \ip) is e-t-halting 
for M , and is 5-t' -halting for M with t ^ t' , and if £ + S < 1, then 



Proof. We may assume that t < t' . Then we have 

{qf\Ml,{\ip){^\)\qj) > 1 - e and (g^|M*,(|V^) (V^|)|gy) < 5. 

By the monotonicity of the trace distance with respect to quantum opera- 
tions and the definition of the trace distance for pure states together with 
Lemma \AA\ we get 

l-s-6 < \{qf\M'ci\^){ip\)\qf)-{qf\M'cmmQf)\ 

< \\M'cm{i^\)-M'ci\^){ip\)\\ 

< \\M'cm{i;\)-M'c{\v){^\)\\^^ 

< \\\^P){^P\-\^){ip\U = y^T^m^■ 

The claim follows by rearranging. □ 

We are now ready to prove the promised result about halting stability. 
The idea is to show in the first part of the proof that every pure qubit string 
of fixed length n which makes a QTM M almost halt at time t is close to 
some "approximation subspace" L^^j (t) C TLn- Under certain assumptions 
on the halting accuracy, the dimensions of the spaces (t) for different t 
add up to at most 2" = diuiTCn- 

Then, as the second part of the proof, we can repeat the construction 
from Section 12.31 where the halting spaces are replaced by these approxi- 
mation spaces: we split every vector from L^^{t) into some classical and 
quantum part, and we can write a computer program for the UQTM it that 
extracts the approximate halting time from the classical part, then simulates 
the QTM M for the corresponding number of time steps, and finally halts 
with probability one. 

Note that it is not trivial that such subspaces L^^{t) with the aforemen- 
tioned properties exist; in particular, the halting spaces 'H^^^ {t) themselves 
do not have this approximation property. It is also does not seem that the 
approximate halting spaces Tl^^'^^ {t) from Definition 12.3.101 can be used in- 
stead. 
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Theorem 2.4.4 (Halting Stability) For every 6 > 0, there is a sequence 
{fln('5)}neN C M'^ such that every qubit string of length n which is a„((5)- 
halting can be enhanced to another qubit string which is only a constant 
number of qubits longer, but which halts perfectly and gives the same output 
up to trace distance 6. 

Moreover, the sequence {a„((5)}„gN is computable. 



Remark. Here is the exact formal statement of the theorem: For every 
6 > 0, there exists a sequence of positive real numbers {an(^)}neN such 
that for every QTM M, one can find a constant!^ cm,s ^ N such that for 
every qubit string a G (Ti^o^ij*) which is an((5)-t-halting for M for some 
t S N and £{a) < n, there is some qubit string a' G 7^^(^10,1}*) with 
i{a') < n + cm,5 such that 

\\H{a')-n{M'oi^))\\^^<6, 

where it is some strongly universal QTM. Furthermore, ii halts perfectly on 
input a', and the map {n,5) i— > an{6) is computable. 

Proof. Assume that 6 £ (0, 1) n Q. We introduce two different norms 
that will be useful in the proof. For every ^' = . . . , \ip2")} C TCn which 

is a basis of Tin consisting of normalized vectors, and for every \{p) £ Tin, 
we define 

2" 2" 

II Iv?)!!* := X] if 1'/^) = X]"»l^»)- 

i=l 1=1 

It is easily checked that || • is a norm on TCn for every basis "if. Suppose 
we have a set of vectors ^ = • • • , IV'2")} C Sn with the property 

II m - M\ > 2 for every IV-) G span{ | ) , . . . , |V^i_i)}, (2.18) 

then it is easily checked that the vectors of this set must be linearly inde- 
pendent. Since 7^^' = 2", ^ must be a basis of ?{„,■ Thus, the expression 

111^^)11(5) :=sup{|||^)|k I * = {|V'i),---,|V'2")} C5„,(I2I8D holdsfor 

is well-defined for every \ip) G Tin- Yet, it might be infinite for some \ip). To 
see that it is finite for every \ip) £ Tin, note that the set 

< ^' G S„ X 5„ X . . . X S„ I (fTTHD holds for ^ 

^ V ' 

2" factors 
^"Note that cm,6 does not depend on n. 
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is compact in (Wn)^", and the map ^' i— > || is continuou£l]on this set 

and must thus have a maximum. 

One easily checks that || • \\(^s) is also a norm on Tin- Since all norms on 
finite-dimensional linear spaces are equivalent, it follows that 



m„(5) := sup II |i^/||(5) 



is finite, and ran{5) G for every n. Now we set 
o-n{^) ■= min 



1 - Vl - 2-2" 



6(m„(<5))^ 3 J 

It is clear that the map {n,6) a„(5) is computable, although we do not 
have an explicit formula for it. 

According to Lemma 12.3.171 we may assume that M is a fixed-length 
QTM. Fix some algorithm that on input n S N and S £ Q"*" computes some 
discretization 

:= {|^S")(<5)), |v.(")(<5)), . . . , C Sn 

of the unit sphere 5„ C W„, with N = < oo. The discretization 

shall be an{S)-dense in the unit sphere 5^ C Tin, i-e. for every G Sn, 
there shall be some vector \ip') G d^"'\5) such that || \ip) — \ip')\\ < an{6). 
Moreover, we demand that span = Tin- For every e > 0, let 

d^^j^{6,e,t) := {|(^) G | |^) is e-t-halting for M}. 

Now we construct some coarsening L>j^"^ {6, e, t) C cf^j {6, e, t) in the following 
way: First, we choose an arbitrary vector IV'i) G d^^^ {6,e,t). Then, one after 
the other, we choose vectors G d^^^{6,e,t) such that no vector is |-close 
to the span of the previously chosen vectors. We stop as soon as there is no 
more such vector. 

This way, we get a finite set D^^\6,e,t) = {IV'i)) • • • ! iV'm)} C Sn with 
the following properties: 

• For every vector \ip) G d^^^ {d,e,t), there is a vector \ip') G 
span D^^\6,e,t) such that || |(/?) — |(/?')|| < |. 

• Equation p. 181) is valid for every i. 
Now we define the linear subspaces 

:= span {5, e,t). 



^'^To see that this map is continuous, note that 'if can be interpreted as an invertible 
2" X 2"-matrix. Thus, |[ = ||*~^lv3)|| j, and the map >)/ i 
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Suppose that \lp) G L^^j^{6,e,t) is a normalized vector. In this case, \ip) can 
be written as \ip) = X^jOilVi), where {\^,)} C C 
is a basis of L^'*((5, e, t), and every is e-t-halting for M. Choose some 
orthonormal basis of L^^j {6, e, t)-^ , and append those vectors to to get 

a basis ^ of Tin- It follows that Y^ - \ai\ = \\ \(p)\\';t < || < rnn{S), and 

Lemma 12.4.21 implies: 

Every normalized vector \(p) G L^^^{6,e,t) is (m„((5)^ • e) -t-halting for M. 

Now suppose that e is any real number satisfying 

1 - Vl - 2-2" 

< e < ^ (2.19 

2(m„(5))2 

It follows that if \ip) G [5, e,t) is normalized, then is better than 
^-^-"^^^ — -t-halting for M. If It/j) G L^"'*((5, e, t') is another normalized vec- 
tor with different approximate halting time t' ^ t, then it follows from 
Lemma [2X3] that \{i/j\(p)\ < 2"". 

Suppose now that ^jgj^dimLj^^((5, > 2". Then, by choosing or- 
thonormal bases in all spaces L^^(5, e, t), we could choose 2" -|- 1 vectors 
{\vi)}f_l^ , such that their inner product satisfies < 2"" = 2n^\_i 

for every i ^ j. Lemma IA.2I would then imply that the vectors were all 
linearly independent, which is impossible. Thus, 

dim lJJ^ {5,e,t) <2"' if e satisfies (l2l9D , e.g. for e = 2a„ (S) . 

On the other hand, suppose that \ip) G Sn is an((J)-i-halting for M. Then, 
there is some vector \ip) G S'^\5) such that \\\ip) — \(f)\\ < an{5). Ac- 
cording to Equation (j2.12p . the vector |(^) is 2a„(5)-t-halting for M, so 
{if) G d^^j^ {6,2an{5),t). By construction, it follows that there is another 
vector \ip') G ^^"^((5, 2a„(5), t) with \\\ip) - \ip')\\ < f, so \\\ip) - \ip')\\ < 
On(<5) + f ^ The approximate outputs of M on inputs \ip) and \(p') are 
then also (5-close: 



\\noM'oi\ip){v\)-noMU\v'){^'\)\\Tr < \\\v){ip\-\^'){ip'\ 



Tr 



< |||</^)-|v^')ll<^'J, (2.20) 

where we have used Lemma lA.ll and IA.6I 

From that point on, we have the same situation as in Section 12.31 where 
we proved the existence of a strongly universal QTM: we have a collec- 
tion of subspaces {L^^j {6,2an{d),t)}t£N such that their dimensions add up 
to at most 2". We can now use a construction that is analogous to that 
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in Subsection 12.2.31 For every vector \ip) G 5„ that is an(5)-halting for 
M, we can find some vector G IJ^gpj 2a„((^), t) such that (|2.20p 

holds. We can divide \lp') into a classical part, consisting of a prefix code 
ct E {0, 1}* of the number of the corresponding subspace that contains 
I and a quantum part C\ip')^ consisting of a compression of \^p') down to 

[logdimL^^(5, 2a„((^), t)] qubits. 

The idea now is that the universal QTM 11 works as follows: On input 
(5, ®C\ip')), where sm is a description of the QTM M, the universal 

QTM it shall compute the halting time t from q, approximately decompress 
\lp') from C I (/?'), and then simulate M for t time steps on input \ip') and halt. 

Again, U cannot apply these steps exactly, but has to work with numer- 
ical approximations of the spaces L^''((5, 2a„(5), t). These approximations 
have to be good enough such that the resulting error is bounded from above 
by |(5, such that the resulting total error (by adding p. 201) ) is less than 5. 

This construction is completely analogous to the construction of the 
strongly universal QTM il in Section 12. 3| it is even slightly simpler, since 
we do not need any "fine tuning map" V as in the proof of Theorem 12.2.11 

□ 

As On ((5) turns to zero exponentially fast for n — > oo, this theorem only 
applies to almost halting inputs that are extremely close to perfect halting. 
Maybe it is possible to prove more general or less restrictive versions of this 
theorem by allowing a larger blow-up of the program length (e.g. a factor 
larger than one, instead of an additive constant). Another possibility might 
be to use a different definition of "e-halting": Instead of Definition [2331 one 
might instead define an input as e-halting at time t, if an outside observer 
who is continuously measuring the halting state of the control observes halt- 
ing at time t with probability larger than 1 — e. 

Despite this restriction, the theorem proves that the definition of halting 
by Bernstein and Vazirani [1] has some unexpected built-in error tolerance, 
which makes that halting scheme look quite reasonable. 



Chapter 3 



Quantum Kolmogorov 
Complexity 

3.1 Definition of Quantum Kolmogorov Complex- 
ity 

The notion of quantum Kolmogorov complexity that we study in this thesis 
has first been defined by Berthiaume, van Dam, and Laplante [5]. They 
define the complexity QC{p) of a qubit string p as the length of the shortest 
qubit string that, given as input into a QTM M, makes M output p and 
halt. 

Since there are uncountably many qubit strings, but a QTM can only 
apply a countable number of transformations (analogously to the circuit 
model), it is necessary to introduce a certain error tolerance 5 > 0. 

This can be done in essentially two ways: First, one can just fix some 
tolerance 5 > 0. Second, one can demand that the QTM outputs the qubit 
string p as accurately as one wants, by supplying the machine with a second 
parameter as input that represents the desired accuracy. This is analogous 
to a classical computer program that computes the number vr = 3.14...: 
A second parameter A: G N can make the program output vr to A; digits of 
accuracy, for example. We consider both approaches at once, and get two 
different notions of quantum Kolmogorov complexity, namely QC^ and QC. 

Moreover, while Berthiaume et al. only allow inputs that are length 
eigenstates, base length i and average length H coincide for their approach. 
We want to be more general and allow arbitrary superpositions and mixtures, 
i.e. qubit strings a G '^^{^{0,1}*) inputs. Thus, the number of possible 
definitions doubles again, depending on the way we quantify the length of 
the input qubit strings. We get on the one hand the complexities QC and 
QC^ for base length I, and on the other hand the complexities QK and QK 
for average length L 

According to Conjecture 12.2.31 we can only hope to prove the invariance 
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property (cf. Section [33]) for average- length complexities QK and QK if we 
restrict them to prefix QTMs, i.e. if we define them as quantum analogues 
of classical prefix complexity. Since classical prefix complexity is often de- 
noted by K, while plain Kolmogorov complexity (with no restriction on the 
reference Turing machine) is denoted by C, this explains why we chose the 
notation QK and QK . 

Another difference to the definition by Berthiaume et al. is that we use 
the trace distance rather than the fidelity to quantify the similarity of two 
qubit strings. 

Definition 3.1.1 (Quantum Kolmogorov Complexity) Let M be a 

QTM and p G 7'i^(W{o,i}*) an indeterminate-length qubit string. For every 
5 > 0, we define the finite-error quantum Kolmogorov complexity QCfj{p) 
as the minimal length of any qubit string a G '^^('^{0,1}*) such that the 
corresponding output M{a) has trace distance from p smaller than 5, 

QCijip) := mm{£{a) \ \\p - M(a)||Tr < 6} . 

Similarly, we define the approximation-scheme quantum Kolmogorov com- 
plexity QCm{p) o,s the minimal length of any qubit string a G '^^('^{o,i}*) 
such that when given M as input together with any integer k, the output 
M{k,a) has trace distance from p smaller than 1/k: 



QCm{p) := min <^ i{a) 



\p — M{k, ct) IIti < 7 for every k £N 
K 

We define two analogous notions of complexity, where base length £ is re- 
placed by average length I: if M is any QTM, then 

QkUp) ■■= inf {^» I \\P - M(a)||Tr < S} , 



QKM := mfY{a)\\\p-M{k,a)\\'T,<- for every ken 

Note that the specific choice of f{k) := 1/k as accuracy required on input k 
is not important; any other computable and strictly decreasing function / 
that tends to zero for A: — > 00 such that f~^ is also computable will give the 
same result within an additive constant, as long as M is a strongly universal 
QTM and the quantum complexity notions all have the invariance property 
(which we discuss in Section 13. 3p . 



The idea to define some notion like QK is due to Rogers and Vedral [3^ . 
In Chapter HJ we argue that the notion of complexity QK is more useful 
for applications in statistical mechanics than QC, since the average length 
sometimes has a physical interpretation as the expected energy cost of com- 
munication. 
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In this thesis, we wih most of the time restrict to the complexity notions 
QC and QC^ , since they are much easier to handle. The main technical 
reason for this is that the pure qubit strings \ip) with base length (■{\^p)) < n 
are all elements of one Hilbert space TCku, which is not true for average 

length. Nevertheless, we study the complexities QK and QK^ to some extent 
in Section [331 

For later use, we note a simple relation between the two quantum com- 
plexities QC^ and QC: 



Lemma 3.1.2 (Relation between Quantum Complexities) 

For every QTM AI and every /c G N, we have the relation 

Qclip) < QCm{p) + 2[\ogk\ + 2 for every p G T+(W|o,i}0- (3.1) 



Proof. Suppose that QCm{p) = I, so there is a density matrix a G 
Tj^+(W{o,i}.) with £{a) = /, such that \\M{k,a) - pWtt < I for every /c G N. 
Then a' := {k,a), where (•, •) is given in Definition 12.1.71 is an input for M 

such that ||M(c7')-p||Tr < p Thus QCl^''{p) < i{a') < 2[logA;J +2 + i{a) = 
2[logA;J + 2 + QCm{p), where the second inequality is by (|2.6|) . □ 

The term 2[logA;J + 2 in (13. ip depends on our encoding (•,•) given in 
Definition 12.1.71 but if M is assumed to be universal (which will be dis- 
cussed below), then (13.11) will hold for every encoding, if we replace the term 
2[logA;J +2 by K{k) + CM, where K{k) < 2[logA;J +0(1) denotes the classi- 
cal (self-delimiting) algorithmic complexity of the integer k, and cm is some 
constant depending only on M. For more details we refer the reader to |23j . 

3.2 Incompressibility Theorems 

In the theory of classical Kolmogorov complexity and in its applications, 
a simple but powerful argument used frequently in proofs is the so-called 
incompressibility theorem. It can be stated in the following way [231 Theorem 
2.2.1]: 

If c is a positive integer, then every finite set A of cardinality m has at 
least m(l — 2~'^) + 1 elements x with C{x) > logm — c. 

In this section, we are going to prove three quantum analogues of this 
theorem. The first version is a very general theorem on the number of mutu- 
ally orthonormal vectors that can be close in trace distance to the output of 
some quantum operation. We call it "quantum counting argument" , because 
it is a quantization of a classical counting argument, saying that there can 
be no more than 2"' different bit strings that have programs of length less 
than n. 
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Nevertheless, the theorem that follows is not restricted to the study of 
quantum computers, but is a general result about quantum operations. Its 
proof is based on Holevo's ^-quantity associated to any ensemble Ep := 
{Xi,Pi}^, consisting of probabilities < A, < 1, J2i^i — of density 

matrices pi acting on a Hilbert space H. Setting p := XiPi, the x-quantity 
is defined as follows: 

x(IEp) := S{p) -^XiSipi) = ^XiS{pi,p), 

i i 

where S(-,-) denotes the relative entropy. 



Theorem 3.2.1 (Quantum Counting Argument) 

Let H and Ti! he separable Hilbert spaces with < d := dim 7^ < oo, and let 
S < If S : TiTi) — ^ T{J-L') is a quantum operation, then define 

As := {1^) en' \3ae T+{n) : ||£:(ct) - Ik < ■ 

If Ng C As is an orthonormal system, then 

log rf + 4(5 log I 
log#Ns< Y^^IS- 



Proof. For 5 = 0, the assertion of the theorem is trivial (setting, as 
usual, Olog g := 0), so assume S > 0. We may also assume that A^^ / 0. Let 

Ns =■ {\ipi),...,\ipN)}, 

then by definition, there exist ai G T^{H) such that \\£ (ai) — \ipi) {ipi\ Utt < S. 
For 1 < i < N, define the projectors Pi := \(pi){(pi\, and set Pn+i '■= 
1 — X^^]^ \(pi){ipi\. Let be an orthonormal basis of Ti.'. Now we 

define a quantum operation Q : T{H') —>■ T{C^~^^) via 

TV+ldim-H' 

Yl \ei){k\PiaPi\k){ei\, 

i=l k=\ 

where {|ej)}^^^ denotes an arbitrary orthonormal basis of C^^^. It is clear 
that Q is completely positive (Kraus representation), and one easily checks 
that Q is also trace-preserving. This is also true if dim 7^' = oo; then, the 
corresponding infinite series is absolutely convergent in || • ||Tr-norm, and 
inherits complete positivity from its partial sums. Moreover, for 1 < j < N , 
we have 

QiPj)=J2\''j){k\Pj\k){ej\ = |e,)(e,|. 

k 
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Consider the equidistributed ensemble Eq- := and let a := 

7f Si^i ^i - t° the monotonicity of relative entropy with respect to quan- 
tum operations, we have 

TV N 
i=l i=l 

= x(E<.)<logd. 

The trace distance is also monotone with respect to quantum operations (cf. 
Lemma lA.ip . Thus, for every 1 < i < N , 

\\Qo£{a,) - Q{Pi)\\^^ < \\£{a,) - PilWr = \\£{(Ti) - \ipi) {ifiWhr < S. 
Let now A := i Q{Pi) = i ^^=1 \ei){ei\, then 5(A) = logiV, and 

1 ^ 

HQ o £ia) - A||t, < ^ E 112 ° ^(^^) - < ^- 

i=l 

The Fannes inequality [3^ 11.44] yield^ for 1 < i < N 

S{Qo£{a,)) = \S{Qo£{a,))-S{QiPi)) \ < 26log{N + 1) + rj{25), 
\S{Qo£{a))-S{A)\ < 2Jlog(iV + l) + ??(25), 



where r]{6) = —5 log 5 > 0. Altogether, we get 

N 

N 



logd > x{Q°£{^a))=S{Qo£{a))-^Y.S{Qo£{a,)) 

i=l 
1 ^ 

> 5(A) - 25 logiN + 1) - 1^(25) - ^ E + 1) + 

i=l 

= log iV - 4(5 log(A^ + 1) - 2?7(25) 

> (1 -4(5) log iV- 45 log 2 + 4(5 log(2(5), 

where we have used the inequality log(A^ + 1) < logA^ + log 2 for > 1. 
The claim follows by rearranging. □ 

We will use this "quantum counting argument" later in Section 13.41 and 
13. 5t it will be useful in several proofs. Specifying it to the case that the 
quantum operation corresponds to the action of a QTM, we get the following 
incompressibility theorem for quantum Kolmogorov complexity QC^: 



^Note that the notation in [30] differs from the notation in this thesis: it holds T{p, a) = 
Tr|p - o-| = 11/9 - a\\i = 2 ■ Hp — o-||Tr- 
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Corollary 3.2.2 (Incompressibility for Orthonormal Systems) 

Let M he a QTM, let < 6 < and let ■ ■ ■ , \ipn) S "^{o,!}* a set of 
mutually orthonormal pure qubit strings. Then, there is some i G {1, . . . ,n} 
such that 

QCUm) > (l-45)logn- 1-4,5 log ^. 



Proof. Let / G N be a natural number such that QC'l^dV'*)) — ^ for 
every i G {l,...,n}. Then, there exist qubit strings dj G T^{7{<i) such 
that ||A^(o"j) — \tpi){^pi\ Utt < 5, where Ai is the quantum operation that 
corresponds to the QTM M, cf. Lemma 12.3.41 Thus, Theorem 13.2.11 yields 

log dim W<i + 4,5 log 4 / + l + 451ogi 
^ 1^45 < 1-4^ ■ 

It follows that /> (1 - 4,5) log n - 1 - 45 log ^. □ 

In [SI Theorem 6] , Berthiaume et al. prove the following incompressibility 
result for the approximation-scheme complexity QC: if pi, • • •_, Pm is any set 
of qubit strings, then there is some i G {1, . . . , M} such thaln 



/ A/ \ M 
\ i=l J i=\ 



1. 



Note that the quantity on the right-hand side is exactly Holevo's x-Quantity 
associated with the ensemble Here, we give a generalization of 

this result to the complexity notion QC^ . The proof is very similar to the 
proof of the quantum counting argument, Theorem 13. 2. H the only difference 
is that we need a different quantum operation Q. 



Theorem 3.2.3 (Incompressibility for Pure Qubit Strings) 

Let M he a QTM, and let \ipi), . . . , iV'n) G "^{o,!}* be a set of pure normalized 
qubit strings. Then, there is some i G {1, . . . ,n} such that 



where S denotes von Neumann entropy. 



^The "-l"-term is missing in their paper. 
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Proof. Let Z G N be a natural number such that QCfjdipi)) < I for 
every i G {!,..., n}. Then, there exist qubit strings fjj G T^{7{<i) such 
that ||A^((Ti) — \^i){ipi\ IIti < where Ai is the quantum operation that 
corresponds to the QTM M, cf. Lemma 12.3.41 

Let n := span{|V'i)}f=i, let N := dimW, and let U : H ^ C^+^ be 
an arbitrary isometry (i.e. a unitary map from 7i to some A^-dimensional 
subspace of C^"^^). Let |e) G C^"*"^ be a normalized vector from (ranC/)-*-. 
Then, define a quantum operation Q : T('H|o^i}*) — > T(C^"^^) via 

oo 

Q{a) := UPnaPnU* + ^ \e){k\{l - Pn)a{l - Pw)|fe)(e|, 

fe=i 

where {|Zc)}^^ denotes an orthonormal basis of TY"*" in Wjo,!}*, and Pn 
denotes the orthogonal projector onto Ti.. It is easily checked that Q is linear 
and trace-preserving, and it is clear that Q is completely positive (Kraus 
representation). Moreover, 

Qi\i^i){i^i\) = U\^P^){7Pi\U* for every 1 < i < n. 

As the trace distance is monotone with respect to quantum operations (cf. 
Lemma lA.ip . we get 

\\QoM{a^) - Qimi^PiDhr < \\M{ai) - |V^i)(^,| Hxr < S. 

Let A := ^ ^17=1 Qili^i) ii^il) ■ Since the trace distance is jointly convex (cf. 
[30]). we also get 



/ n \ n 

QoAl -VaJ-A <-y\\QoM 
\ n ^-^ I n ^-^ 

\ 1=1 / Tr *=1 



{'J^)-Qmmu<5. 

n ' — • 

Tr 

For 1 < i < n, the Fannes inequality [30, 11.44] yields 



S{A) - S [^YlQo M{a,)^ 



< 25log{N + l)+i]{26), 
\S{QoM{ai)-S{U\iJi){iPi\U*)\ < 25log{N + l)+T]{26), 

' V ' 



where r/(x) = — xlogx > 0. Now consider the equidistributed ensemble 
{n''^«}i=i- '^^^ monotonicity property of Holevo's x quantity gives 

l + l > logdimH<;>x(E,)>x(-M(E<x))>x(Qo-M(IEa)) 

/ n \ n 

1 " 

> 5(A) - 25 log{N + 1) - r,{26) --^{26 log(iV + 1) + ry(2<5)) 

1=1 

= s(^Yl^\i^,){'iP,\)^ -4<51og(7V+l)-4r51og^. 
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Using that N < n, the claim follows. □ 

3.3 The Invariance Property 

The most important theorem for classical Kolmogorov complexity is the 
invariance theorem. Basically, it says that Kolmogorov complexity does not 
depend too much on the choice of the corresponding TM. In more detail, 
there is a ("universal") TM U such that for every TM M, there is some 
constant ca/ G N such that 

Cu{s) < Cm{s) + Cm for every s G {0, 1}* 

(cf. [23]). Consequently, if U and V are both universal TMs, then the differ- 
ence of the corresponding complexities \ Cir{s) — Cv{s)\ is uniformly bounded 
by a constant. Since additive constants do not matter so much for many 
applications, this means that we can define Kolmogorov complexity with 
respect to any universal computer we want. 

It follows from the results in Section 12.21 and 12.31 that both quantum 
Kolmogorov complexities QC and QC^ are invariant as well: 



Theorem 3.3.1 (Invariance of Q-Kolmogorov Complexity) 

There is a fixed-length quantum Turing machine ii such that for every QTM 
M there is a constant cm G N such that 

QCn{p) < QCm{p) + Cm for every qubit string p. 

Moreover, for every QTM M and every 5, A G with 6 < A, there is a 
constant cm,s,a £ N such that 

Q^nip) — Q^iiip) + cm,s,A for every qubit string p. 



As a consequence, we now fix an arbitrary QTM il with the property of 
Theorem [3X11 and define QC{p) := QCu(p) and QC\p) := QC^ip) for 
every qubit string p G {T-L^Q^iy) and 5 > 0. 

Proof of Theorem 13.3.11 First, we use Theorem 12.2.11 to prove the 
second part of Theorem 13.3.11 Let M be an arbitrary QTM, let il be the 
( "strongly universal" ) QTM and cm the corresponding constant from Theo- 
rem [TSU Let (. := QCl^{p), i.e. there exists a qubit string a G 'T'^{H^Qiy) 
with £{a) = i such that ||M(a")— /o||Tr < According to Theorem l2.2.H there 
exists a qubit string aM G '^^('^{0,1}*) with 1{cjm) < ^(f) + cm = (- + cm 
such that 

||il(A-5,aM) -M((t) llTr <A-5 . 



3.3. The Invariance Property 



69 



Thus, ||il(A - 6,aM) - p\\Tr < A, and £{A - d^au) = ^{(^m) + ^(A - 5) < 
i + Cm + C5,A) where cs^a G N is some constant that only depends on 6 and 
A. So QC^ip) < i + CM,5,A- 

The first part of Theorem 13.3.11 uses Proposition 12.2.21 Again, let M 
be an arbitrary QTM, let il be the strongly universal QTM and cm the 
corresponding constant from Proposition 12.2.21 Let i := QCm{p)-, i-e. there 
exists a qubit string a G '^^('^{0,1}*) with i{a) = i such that 

||M(/c,cr) - pIItt < \ for every /c e N . 

K 

According to Proposition [2221 there exists a qubit string gm £ "^i^ {'^{0,1}*) 
with i{aM) < ^(o") + Cm = ^ + cm such that 

||il (/c, cjAf) - M {2k, a) ll^r < ^ for every A: G N . 

Thus, mk,aM) - p\Wr < mk,aM) - M(2A;, a)||Tr + \\M{2k,a) - pHxr < 
^ + IS = i fo^ every A; G N. So gC^(p) < £ + cm- □ 

Does the invariance property also hold for the average length complex- 
ities QK and QK ? If Conjecture 12.2.31 holds true, then we can repeat the 
proof of invariance of QC^ without changes for QK . Thus, we conjecture 
that the following holds true: 

Conjecture 3.3.2 (Invariance of Average-Length Complexity) 

There is a prefix QTM 5J such that for every prefix QTM M and every 
5, A G with 6 < A, there is some constant cm,s,a such that 

QK^{p) < Qk\,[{p) + cm,5,a for every qubit string p. 

What about the complexity notion QK? The question whether QK is 
invariant depends on the question whether Proposition 12.2.21 can be gener- 
alized to average length £. We think that this could be possible, but have no 
idea how to prove it. 

A simple consequence of the invariance property is that the quantum 
Kolmogorov complexity of some qubit string is bounded from above by its 
base length: 



Lemma 3.3.3 There is some constant c G N such that 

QC{p) < i{p) + c for every qubit string p. (3.2) 
Similarly, for every 5 G Q^, there is some constant q G N such that 

QC^{p) < £{p) + cs for every qubit string p. (3.3) 
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Proof. Recall the construction used in the proof of Lemma 12.3.171 to 
compress indeterminate-length qubit strings into fixed-length qubit strings 
which are only one qubit longer. We are using the same idea to construct 
a fixed-length QTM M with QCm{p) < Kp) + 1- Then, Equation 1^ fol- 
lows immediately from Theorem 13 . 3 . 1 1 (the invariance property), and Equa- 
tion ()3.3p follows from Lemma 13.1.21 

Going back to the idea of Lemma 12.3.171 as 2"'"'"^ — 1 = dim'H<„ < 
dimTCn+i = 2"+^, we can embed Ti.<n isometrically in Tln+i in a simple 
way, e.g. by mapping computational basis vectors to computational basis 
vectors. This transformation can be extended to a unitary transformation 
Un on 'H<(„+i), again simply by mapping computational basis vectors to 
computational basis vectors, such that there is a QTM that can apply each 
Un for every n (and its inverse U~^) exactly, i.e. without any error. 

The fixed-length QTM M works as follows on input (k, a), where /c G N 
is some integer, and a € UneNo^^(^") some fixed-length qubit string: 
First, it reads and ignores k. Then, it determines n + 1 = £{a) by detecting 
the first blank symbol 7^ on its input track. Afterwards, it applies on 
the corresponding n + 1-block of input track cells exactly, moves this block 
to the output track and halts. Then M has QCm{p) = £{p) + 1- ^ 

If the complexity notion QK^ is really invariant as stated in Conjec- 
ture 13.3.21 then the following result might give an analogue of Lemma 13.3.31 



Lemma 3.3.4 For every 5 G Q''", there is a QTM M such that 

Qk\[{p) < £{p) + 0{log£{p)) for every qubit string p. 



For simplicity of the proof, we let M depend on 6 here, which can be 
avoided. Unfortunately, it is not clear whether M can be constructed to be 
prefix. 

Proof. The QTM M expects input of the form (c|-^(o-)-| 18) o"), where a is 
an arbitrary indeterminate-length qubit string, and {c„}ngNo C {0, 1}* is a 
classical prefix code that encodes the natural numbers into binary strings; 
it is well-known that this can be done in a way such that £(c„) = O(logn). 

The QTM starts by reading C|-^(^-)-|, and decodes [^(cr)] from it. Then, 
it determines some A; G N such that ||c7 — (T^Utt < where is defined in 
Definition 12.3.51 Finally, it moves the first k qubits of a from the input to 
the output track and halts. 

The only remaining question is how the aforementioned integer k can be 
determined. First suppose that a = |^)(^| is a pure qubit string. 

Let sin G {0, 1}* be the n-th classical string in lexicographical order of 
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length I. Then, we can write 



oo 2' 



1=0 n=l 

Let \ip{k)) := X]f=o I]n=i "in|sz„), then 

oo 2' 

\4^)-\m)f 



/=fc+l n=l 



oo 2' 



l=k+ln=l 



Thus, we get 

{k+i)\\m-\m)f 



oo 2' 



(/c + l) J];|a,„|2 < ^ ;j^iai„p 

l=k+l n=l l=k+l n=l 

oo 2' 

< j;/^h„P = (^|A|V)=^"(|V'». 

i=0 n=l 

From Lemma lA.4( it follows that 



\^p){^p\-\iJik))mk)\\\Tr<\\\i^)-\m)\\< 



k + l' 



As quantum operations are contractive (cf. Lemma lA.ip . restricting both 

states to the first k qubits yields || \'>p){ip\i — \ip{k)){ip{k)\ ||Tr < \/ ^k+i ' 
by the triangle inequality 



lIlTr 



< 2i 



'mi 

A; + 1 ' 



Now suppose that a is an arbitrary mixed qubit string. Let a = J2i ■^i|V'i)(V'i| 
be its spectral decomposition. Using the joint convexity of the trace distance 
and the Cauchy-Schwarz inequality, we get 



F ~ llTr 



Tr 



|Tr 



< ^Xi\\\i^i)m-\i^i)mi\ 

i 



k + l 



Thus, k just has to be chosen large enough such that the right-hand side is 
less than 6. □ 
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3.4 Quantum Complexity of Classical Strings 

Quantum Kolmogorov was meant to be a generalization of classical Kol- 
mogorov complexity. In this section, we show that this point of view is 
justified by proving that at the domain of classical strings, quantum and 
classical Kolmogorov complexity basically coincide up to an additive con- 
stant. Thus, quantum Kolmogorov complexity extends classical complexity 
in a similar way as von Neumann entropy generalizes Shannon entropy. 

We start with a lemma which says that classical complexity is bounded 
from above by quantum complexity. This was formulated as an open problem 
in the first paper on this complexity notion by Berthiaume et al. [5]. Later, 
Gacs proved some prefix-free analogue of (j3.4p indirectly in [14]. 



Lemma 3.4.1 (Classical Complexity < Quantum Complexity) 

For every QTM M , there is a constant cm £ N such that 

C{s) < QCm{\s)) + CM for every s G {0, 1}*. (3.4) 
Moreover, for every 6 G (O, ^) Pi Q, there is a constant cs^m £ such that 

Cis) < 9^mM1 + cs,M for every s G {0, 1}* . (3.5) 



Proof. According to Lemma 12.3. 17^ we may without loss of generality 
assume that M is a fixed-length QTM. We give a classical computer program 
P that, on input i, n G N and 6 G (0, ^) n Q, together with a description of 
a QTM M, approximately outputs the i-th string that is generated by the 
QTM M on some input of length n. The program P works as follows: 

(1) Set the time t := 1 and the counter c := 0. Compute some number 
e G (0, gg2-2«) n Q such that e <^{^-6). 

(2) Compute a description of the approximate halting space nfj'\t). If 
nti'"\t) = {0}, go to step (4). 

(3) Compute a finite set of self-adjoint matrices T such that for every 
a G {Tl^^j''^\t)) there is a matrix a ^ T such that ||o" — (T||Tr < £ 
and vice versa. For every matrix a £ T, 

— simulate the QTM Af on input a for t time steps, that is, compute 
an approximation of the output of M on input a such that 
||7^(M*3(a)) -p^ll^^ <e; 

— for every w G {0, 1}* with i{w) < t, compute an approximation 

of 11/95- — \w){w\ llxr such that \Aw — \\pa — \w){w\ UttI < e; 
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— if A^u < 6 + -^e, then set c := c + 1. If c = i, then output w and 
halt. 

(4) Set t -.= 1 + 1 and go back to step (2). 

The proof wih consist of two parts: In the first part, we show that the 
program P finally generates every string s with QC\^j{\s)) = n for some 
appropriate input i. In the second part, we show that the number i is not 
too large, such that it can be specified by a short binary string. 

For the first part, suppose that s G {0, 1}* is a binary string such that 
QC\,j{\s)) = n. By definition, it follows that there is some a S T^{Hn) 
such that ||M((t) — \s){s\ \\rp^ < 6. If T is the corresponding halting time 
and a = '^il^i) spectral decomposition of a, it follows that 

\(pi) G H^\t) for every i. According to Theorem 12.3.121 there are vectors 
£ H^^/^\t) such that || \(pi) - < ^-e. Let a' := Y^iLi M'Pi){'Pi\ ^ 

T^{n^^/\T)), then ||ct - a'||Tr < according to Lemma |A31 

If the program P has run long enough that t = T, there is by assumption 
some a £ T such that ||(t' — fT||Tr < According to Lemma lA. 11 we have 

\\n{Ml{a))-\s){s\\\^^ < \\M{a)-\s){s\\\T.^ + \\n{ME{a))-M{a)\\^^ 

< + ||cr — cr||Tr < + —e. 

Thus, ||/>5- — \s){s\ ||rpj. < 5 + ^e. In step (3) of the program P, if w = s, it 
will then hold that < 6 + ^-e, and the program P will output the string 
s if the input i has been appropriately chosen. This is true for every string 
s G {0,1}* with QCIj{\s)) =n. 



Now suppose some classical string w G {0, 1}* is output by P on some 
input i. In this case, it will hold A^ < <5 + in step (3) of the program P, 
and thus, \\pa — \ w){w\ Wtt < ^ + Thus, if t is the corresponding halting 
time, we have 

\\n{M'o{a)) -\w){w\\\^^ < \\n{M'o{a)) -pa\\^^ + \\pa-\w){w\\\^ 

r 21 

By definition, there exists some a G {Tl^j!^'^\t)) such that \\a — ^Wtt < 



so 



\n{M'oia))-\w){w\\\^^ < ||7^(M*)(a))-7^(M*J(a))||^ 

+ \\n{M'oia))-\w){w\\\^^ 



21 23 

< \\a - a\\Tr + S + —e < 6 + —e. 
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Define St ■=T^° Mq and A := 5 + < and set 

NA{t) := {w G {0,1}* I 3a G T+{nf/'\t)) : \\£t{a) - \w){w\\\Tr < a} 

if dim7{^^j''^\t) > 1, and NA.{t) := otherwise. It fohows from the quantum 
counting argument (Theorem I3.2.1|) that 

Let L be the set of strings that are generated by the program P on any 
input i. (It will turn out that L is finite; if the input i is too large, then P 
will not halt.) As the function x is superadditive on [1, oo) for c > 1, 

and as e < g^2~^" (compare Corollary 12.3. 13p . we get 

logdim?i^"'^\t) + 4Alog ^ 



< 



yeN;dimW5^"'^'(t)^0 

fj:dim<'^)(t).(^ 



aeN 



4A\ 1-4A 



< • I — 



4A 
1 \ 1-4A 



Thus, we get 



log#L< 



n 4A 1 

1 log — . 

1 - 4A 1 - 4A ^ A 



(3.6) 



Now we join both parts of the proof together to show the assumption of 
the lemma. Let T be a classical Turing machine that expects input Xg of the 
following form: 



{0,1}* 9 X, 



description of M, description of 6, classical string s G {0, 1}* 



V 



prefix coded 

The machine T first determines the length £(s) by detecting the first blank 
symbol # on its tape. Then, it computes the number e in the same way 
as given above in step (1) of the computer program P, and A := S + ^e. 
Afterwards, it computes the number n G N as the uniqu^ integer satisfying 



n 



1 - 4A ^ 1 



4A 



4A^°^K 



■^If such an integer n £ N exists, it is unique. Otherwise, we may define the program to 
continue in an arbitrary way, e.g. to halt immediately. 
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Let i be the number of the string s in the set {0, l}^*-*-*. The machine T 
computes the output tt; of P on input i, n, M and 6, outputs w and halts. We 
know from Equation ()3.6p that every word w on the hst L can be constructed 
in this way by choosing s appropriately. We have 

Tl 

i{xs) < — + const A. 



1 1 



n < suPq^^^ j_ ( ] (x) ■ (A — 6)n < const • 2 ^"'n is 



Since 

bounded, we even have 

n 

*i{Xs) < --. 77 + const^. 

i — 4o 

Thus, if w € L is any string on the list, then Ct{w) < j^r^ + const^. Equa- 
tion (jS.Sp now follows from the invariance of classical Kolmogorov complex- 
ity. 

To prove Equation (j3.4p . let V be the classical Turing machine that 
expects input of the form 



{0,1}* 9 X, 



/ \ 

description of M, classical string s G {0, 1}* 

' " ' 

V prefix coded / 



The machine V first determines the length l{s) by detecting the first 
blank symbol # on its tape. Then, it computes n := — 4 and 5 : = 
^(^n+i) ~ T ■ ^ l*-*' le) ^ ^^^^ ^ r^l' Moreover, it computes a 

classical description of the QTM M^, defined by Mk{(j) := M(A;, a) (compare 
Lemma l2.1.8p . Let i be the number of the string s in the set {0, l}^^*). The 
machine V computes the output tt> of P on input i, n, and 5, outputs w 
and halts. 

Suppose that w G {0, 1}* is a classical string with QCm{\w)) = then 
there is a qubit string a G T^{l-in) such that \\M{k,a) — \w){w\ Ijxr < \ for 
every A; G N, in particular for the k given above. Thus, 

\\Mk{a) - \w){w\ lb < 

It follows that the string w is an element of the set L corresponding to the 
input specified above. Moreover, since A < (5 + ^ • ^2~^" = 2{n+i) ' 
length of the list is bounded by 

Thus, the length £(s) = n + 4 is enough to specify any element of the set L, 
and Cv{w) < ^{xs) <n + const. Equation ()3.4p now follows again from the 
invariance of classical Kolmogorov complexity. □ 
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This was the most difficult part. Now, we use a few more arguments to 
prove the main result of this section. 



Theorem 3.4.2 (Quantum Complexity of Classical Strings) 

For every classical string s G {0, 1}*, it holds 

C{s) = QC{\s)) + 0{l), 

i.e. the absolute value of the difference of C and QC is hounded by a constant 
on the domain of classical strings. Moreover, for every rational < <5 < 
there are constants cs,dg EN such that 

QCH\s))<C{s) + cs<^P^ + c's. 



Proof. If G N is large enough such that ^ < 6, then we have 

QC^{\s)) < QC-^{\s)) < QC{\s)) + ks, 

where ks is a constant that depends only on 5. This follows from the obvious 
monotonicity property e < S ^ QC^ < QC^ and Lemma 13.1.21 

Also, we claim that there is some constant c G N such that for every 
classical string s G {0, 1}*, it holds 

QC{\s)) <C{s)+c. 

This can be seen as follows: According to Bennett [3], we can choose the 
classical TM which is used in the definition of C{s) to be reversible. But 
every reversible TM is also a (special case of a) QTM. Thus, this equation 
follows from Theorem 13. 3. H the invar iance theorem for QC. 

All the remaining inequalities are shown in Lemma 13.4.11 □ 

3.5 Quantum Brudno's Theorem 

In this section, we prove a theorem that relates the von Neumann entropy 
rate and the quantum Kolmogorov complexity rate of ergodic quantum in- 
formation sources. This generalizes a classical theorem that has first been 
conjectured by Zvonkin and Levin [38], and was later proved by Brudno [9]. 
The content of this section is joint work with F. Benatti, T. Kriiger, Ra. 
Siegmund-Schultze and A. Szkola, and has already been published in [T]. 

The idea of the classical theorem is to compare two different notions 
of randomness: Kolmogorov complexity, which measures the randomness of 
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single binary strings, and Shannon entropy, which is a measure of random- 
ness for information sources, i.e. probabiUty distributions. 

In more detail, if p is a stationary classical information source, the most 
important parameter is its entropy rate h{p) = lim„^oo ^H{p^"'^), where 
H{p^'^^) denotes the Shannon entropy of the ensembles of strings of length n 
that are emitted according to the probability distribution p*^"-* . According to 
the Shannon- McMillan-Breiman theorem [6l[Tl], h{p) represents the optimal 
compression rate at which the information provided by classical ergodic 
sources can be compressed and then retrieved with negligible probability 
of error (in the limit of longer and longer strings). Essentially, n ■ h{p) is 
the number of bits that are needed for reliable compression of bit strings of 
length n. Thus, h{p) can be interpreted as a measure of randomness of the 
source p and of the ensembles it emits. 

On the other hand, one can look at the randomness of the single strings 
that are emitted by the source. If x is an infinite binary string and x^"^ 
denotes its first n bits, then one can similarly define its complexity rate as 
c(x) := lim„_>oo }[C{x'^'^^) (if that limit exists), where C denotes classical 
Kolmogorov complexity. 

Intuitively, one expects a connection between the randomness of single 
strings and the average randomness of ensembles of strings. In the classical 
case, this is exactly the content of a theorem by Brudno [U HSl [I9l US] which 
states that for ergodic sources, the complexity rate of p-almost all infinite 
sequences x coincides with the entropy rate, i.e. c(x) = h{p) holds p-almost 
surely. 

In this section, we prove that a similar relation holds for the von Neu- 
mann entropy rate and the quantum Kolmogorov complexity rate of quan- 
tum ergodic information sources (we explain this notion below in Subsec- 
tion [33T]). This is an interesting result in its own right, and it also supports 
the point of view that the quantum Kolmogorov complexity notions QC and 
QC^ are useful and natural. 

3.5.1 Ergodic Quantum Sources 

In order to formulate our main result rigorously, we start with a brief intro- 
duction to the relevant concepts of the formalism of quasi-local C*-algebras, 
which is the most suitable formalism for dealing with quantum information 
sources. At the same time, we fix some notation. 

We would like to consider a spin chain of infinitely many qubits. This 
chain is modelled by some C*-algebra the quasi-local algebra, which is 
constructed as follows. 

We consider the lattice Z and assign to each site x G Z a C* -algebra 
Ax being a copy of a fixed finite-dimensional algebra A, in the sense that 
there exists a *-isomorphism i^ : A ^ Ax- To simplify notations, we write 
a E Ax for ix{a) G Ax and a £ A. The algebra of observables associated 
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to a finite A C Z is defined by := ^xeA-^x- Observe that for A C A' 
we have Aj^' = Aa (8) -4.^'^^ and there is a canonical embedding of into 
Aj^i given by a 1-^ a (8) 1a' \A' where a G ^a and 1a' \a denotes the identity 
of v4^'y^. The infinite-dimensional quasi-local C*-algebra A°^ is the norm 
completion of the normed algebra UacZ'^A' where the union is taken over 
all finite subsets A. 

In this thesis, wc only deal with qubits. Thus, in the following, we restrict 
our considerations to the case where A is the algebra of observables of a 
qubit, i.e. the algebra A^2(C) of 2 x 2 matrices acting on C^. 

Similarly, we think of .4a as the algebra of observables of qubit strings of 
length |A|, namely the algebra M2\a\ (C) = A^2(C)®I^I of 21^^! x 2l^l matrices 
acting on the Hilbcrt space TCa '■= (C^)®'^'. The quasi-local algebra .4°° 
corresponds to the doubly-infinite qubit strings. 

The (right) shift T is a *-automorphism on A°° uniquely defined by its 
action on local observables 

T : ae A[m^n] ^ ae A[m+l,n+l] (3-7) 

where [m, n] C Z is an integer interval. 

A state \I/ on A°° is a normalized positive linear functional on A°°. Each 
local state *a := ^ \ Aa, A C Z finite, corresponds to a density operator 
PA £ Aa by the relation ^'A(a) = Tr (pA^), for all a G Aa, where Tr is the 
trace on (C^)®I'^L The density operator pA is a positive matrix acting on 
the Hilbert space Ha associated with ^a satisfying the normalization con- 
dition TrpA = 1. The simplest pA correspond to one-dimensional projectors 
P '■= |V'a)('0a| onto vectors |^a) £ Ha and are called pure states, while 
general density operators are linear convex combinations of one-dimensional 
projectors: pA = Ei ^#a)(V'aI' ^ 0, X)j = 1- 

A state ^ on .4°° corresponds one-to-one to a family of density operators 
PA G -4a, a C Z finite, fulfilling the consistency condition pA = TrA'\A (PA') 
for A C A', where TrA denotes the partial trace over the local algebra ^a 
which is computed with respect to any orthonormal basis in the associated 
Hilbert space Ha- Notice that a state ^ with '^oT = i.e. a shift-invariant 
state, is uniquely determined by a consistent sequence of density operators 
;= pA(n) ill •= '^A{n) Corresponding to the local states ^("^ := 

*A(n)) where A(n) denotes the integer interval C Z, for each n G N. 

As motivated in the introduction, in the information-theoretical context, 
we interpret the tuple (.4°°, describing the quantum spin chain as a sta- 
tionary quantum source. 

The von Neumann entropy of a density matrix p is S{p) := — Tr(plog p). 
By the subadditivity of S for a shift-invariant state on .4°°, the following 
limit, the quantum entropy rate, exists 

s(^) := lim -Sip^''^) . 
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The set of shift-invariant states on A°° is convex and compact in the weak*- 
topology. The extremal points of this set are called ergodic states: they are 
those states which cannot be decomposed into linear convex combinations 
of other shift-invariant states. Notice that in particular the shift-invariant 
product states defined by a sequence of density matrices = p®", n € N, 
where p is a fixed 2x2 density matrix, are ergodic. They are the quantum 
counterparts of Bernoulli (i.i.d.) processes. Most of the results in quantum 
information theory concern such sources, but more general ergodic quantum 
sources allowing correlations can be considered. This is often useful, since 
such sources naturally appear, for example, in statistical mechanics. 



3.5.2 Proof of Quantum Brudno's Theorem 

It turns out that the rates of the quantum Kolmogorov complexities QC 
and QC^ of the typical pure states (i.e. typical pure qubit strings) gener- 
ated by an ergodic quantum source {A°^, ^) are asymptotically equal to the 
entropy rate s{^) of the source. A precise formulation of this result is the 
content of the following theorem. It can be seen as a quantum extension 
of Brudno's theorem as a convergence in probability statement, while the 
original formulation of Brudno's result is an almost sure statement. 

In the remainder of this section, we call a sequence of projectors pn £ 
A^'^\ n G N, satisfying lim^^oo ^^"'\pn) = 1 a sequence of ^-typical projec- 
tors. 



Theorem 3.5.1 (Quantum Brudno Theorem) 

Let {A"^,^) be an ergodic quantum source with entropy rate s. For every 
6 > 0, there exists a sequence of 'i/ -typical projectors qn{5) G A^'^\ n G N, i.e. 
lim^^oo ^^"^(9n('^)) = 1; such that for n large enough every one- dimensional 
projector q < qn{S) satisfies 

-QC{q) £ is-6,s + 5), (3.8) 
n 

-QC^{q)Gis- 6(4 + 6)3,3 + 6). (3.9) 
n 

Moreover, 3 is the optimal expected asymptotic complexity rate, in the sense 
that every sequence of projectors qn G -4^"), n G N, that for large n may 
he represented as a sum of mutually orthogonal one- dimensional projectors 
that all violate the lower hounds in h3. <^|) and h3. 9|) for some (5 > 0, has an 
asymptotically vanishing expectation value with respect to ^ . 
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Proof of the Lower Bound 

A key argument in the proof of the lower bound is the fohowing theorem [71 
Prop. 2.1]. It is closely related to the quantum Shannon- McMillan Theorem 
and concerns the minimal dimension of the typical subspaces. 



Theorem 3.5.2 (|7]) Let (^°°,^') he an ergodic quantum source with en- 
tropy rate s. Then, for every < e < 1, 

lim -f3e,ni^) = s, (3.10) 

where Ps,n{^) ■= min |log Tr„((7) | q G A^"^ projector > 1 — e}. 



Notice that the limit (I3.10p is valid for every e G (0, 1). By means of this 
property, we will first prove the lower bound for the complexity notion QC^, 
and then use Lemma 13.1.21 to extend it to QC. 



Corollary 3.5.3 (Lower Bound for ^QC^) 

Let {A°°,'^) be an ergodic quantum source with entropy rate s. Moreover, 
let0<6<-^, and let (Pn)„gN ^ sequence of ^-typical projectors. Then, 
there is another sequence of ^-typical projectors qn{S) < Pn, such that for n 
large enough 

-QC\q) > 3-5(4: + 6)s 
n 

is true for every one- dimensional projector q < qn{S). 



Proof. The case s = is trivial, so let s > 0. Fix n G N and < 6 < 
and consider the set 

AniS) ■= < Pn \ P one-dim. proj., QC^{p) < ns{l — 5(4 + (5))| . 

From the definition of QC^{p), for all p S An{S) there exist associated 
density matrices dp with i{crp) < ns(l — 5(4+5)) such that ||Z^(crp)— p||Tr < 5, 
where U denotes the quantum operation U : T('H|o.i}*) T{Ti.^Q ij*) of the 
corresponding strongly universal QTM ii, as explained in Lemma l2.3.4[ Let 
Pn{5) < Pn be a sum of a maximal number of mutually orthogonal projectors 
from the set An{d). Lemma 13.2.1 1 imp lies that 



logTrp„(5) < 



logdimW<L„s(i-5(4+5))J +45 log I 



1-45 
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and there are no one-dimensional projectors p < Pn{S) := Pn — Pn{S) such 
that p G An{6). Thus, one-dimensional projectors p < Pni^)'^ must satisfy 
^QC^{p) > s — (5(4 + 6)s. Since logdim'H<c < c + 1 for every c S N, we 
conclude 

limsupilogTrp„(5) < = s - < (3.11) 

n^oo n 1 — 40 1 — 40 

Using Theorem 13.5.21 we obtain that lim„^oo ^^"HPnl*^)) = 0- Finally, set 
qn{S) :=Pn{S)-^. The claim follows. □ 



Corollary 3.5.4 (Lower Bound for ^QC) 

Let [A"^,"^) be an ergodic quantum source with entropy rate s. Let {pn)n&^ 
with Pn G ^^"^ be an arbitrary sequence of ^-typical projectors. Then, for 
every < (5 < there is a sequence of "^-typical projectors qn{S) < Pn such 
that for n large enough 

-QC{q) >s-5 
n 

is satisfied for every one- dimensional projector q < qn{S). 



Proof. According to Corollary 13.5.31 for every k £ N, there exists a 
sequence of ^-typical projectors Pn(^) < Pn with ^QC* (q) > s — -^(4 + 
for every one-dimensional projector q < Pn{^) '^^ n is large enough. We have 

n n n 

k \ k J n 

where the first estimate is by Lemma 13.1.2^ and the second one is true 
for one-dimensional projectors q < Pn{^) and n G N large enough. Fix some 
large k satisfying ^(4-|-^)s < |. The result follows by setting qniS) = Pni^)- 

□ 



Upper Bound 

In the previous paragraph, we have shown that with high probability and 
for large m, the quantum complexity rate —QC^ is bounded from below by 
s(l — 5(4 -|- 6)), and the quantum complexity rate ^QC hy s — 6. We are 
now going to establish the upper bounds. 
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Proposition 3.5.5 (Upper Bound) 

Let {A"^,^) be an ergodic quantum source with entropy rate s. Then, for 
every < 6 < 1/e, there is a sequence of "^-typical projectors qm{5) £ -4^™"^ 
such that for every one- dimensional projector q < qm{^) andm large enough 

and (3.12) 

(3.13) 

We prove the above proposition by explicitly providing a quantum algorithm 
(with program length increasing like m(s + 6)) that computes q within ar- 
bitrary accuracy. This will be done by means of quantum universal typical 
subspaces constructed by Kaltchenko and Yang in [18j. 



Theorem 3.5.6 (Universal Typical Subspaces [18|) 

(n) 

Let s > and e > 0. There exists a sequence of projectors Qa,i 
n G N, such that for n large enough 




Tr^Qg) < 2'"(^+^) 




(3.14) 


and for every ergodic quantum state ^ G S{A°°) 
it holds that 


with entropy rate 


s(^') < s 


lim ^(")(Qi"i) = 1 . 

n— >oo ' 




(3.15) 



We call the orthogonal projectors Q:sJ in the above theorem universal 
typical projectors at level s. Suited for designing an appropriate quantum 
algorithm, we slightly modify the proof given by Kaltchenko and Yang in 

m- 

Proof. Let / G N and R > 0. We consider an Abelian quasi-local sub- 
algebra Cf° C A°° constructed from a maximal Abelian Z— block subalgebra 
Ci C ^(0. The results in [HI |20] imply that there exists a universal se- 
quence of projectors G C^""^ C ^('"■) with ^ log Tr p^^^ < R such that 

lim^^oo tt^^Hp;^) = 1 ergodic state vr on the Abelian algebra 

with entropy rate s{tt) < R. Notice that ergodicity and entropy rate of vr 
are defined with respect to the shift on Cf^ , which corresponds to the Z-shift 
on A"^. 

The first step in [18] is to apply unitary operators of the form C/®"-, 
U G A^''^ unitary, to the p^"^ and to introduce the projectors 

wf^^ := V ;7®>gc/*«- G (3.16) 
C/e^(') unitary 



-QC{q) < s + 6 
m 



-QC\q) < s + 6. 
m 
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Let 

il — Sie/ ^ spectral decomposition of pl*^ (with I C N 

some index set), and let ¥(V) denote the orthogonal projector onto a given 
subspace V. Then, wf^ can also be written as 



w 



R ~ 



span{C/®"Kj"^) ■.ieI,U e unitary} 



It will be more convenient for the construction of our algorithm in 13.5.21 to 
consider the projector 

VF^^'^) := p (^span{A®'^|ig) :ieI,Ae ^(')}) . (3.17) 

It holds that < ^/r"*- integers m = nl + k with n G N and 

k G {0, — 1} we introduce the projectors in A^'^'^ 

We now use an argument of [17j to estimate the trace of W^"^ G A^'^'^ . The 
dimension of the symmetric subspace SYM'^(^(')) := span{A®" : A G ^('^j 
is upper bounded by (n + i)<iim.A(') ^ ^j^^g 

Tr IF^^fl) = TV ly^^S^ • Tr l®'^ < {n + if Tx p^^^l ■ 2^ 

< (n + 1)2'' • 2^" • 2'. (3.19) 

Now we consider a stationary ergodic state ^ on the quasi-local algebra 
A^ with entropy rate s(^') < s. Let e,(5 > 0. If / is chosen large enough 
then the projectors , where R := l{s + |), are 5— typical for i.e. 

\I/{™)(y;(™)) > 1 — (5, for m G N sufficiently large. This can be seen as follows. 
Due to the result in |7t Thm. 3.1] the ergodic state ^ convexly decomposes 
into k{l) < I states 

fc(0 

each i being ergodic with respect to the ^— shift on A"^ and having an 
entropy rate (with respect to the /—shift) equal to s(^') • /. We define for 
A > the set of integers 

Ai,A := {i G {1, . . . , kil)} : 5(^g) > /(s(M/) + A)}. (3.21) 
Then, according to a density lemma proven in [71 Lemma 3.1] it holds 

hm = 0. (3.22) 

l~^oo k{l) 
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Let Ci^i be the maximal Abelian subalgebra of A^^^ generated by the one- 
dimensional eigenprojectors of "^fj G 5(„4^''*). The restriction of a compo- 
nent ^i^i to the Abelian quasi-local algebra is again an ergodic state. It 
holds in general 

I . s{^) = si^.^i) < s{^,,i \ C°?) < Si^fj \ C,,0 = Si^fj). (3.23) 

For i G A' where we set A := y — s(^'), we additionally have the up- 
per bound S{"^fj) < R. Let Ui G A^^^ be a unitary operator such that 
C/f>[}J?7*®" G C,y. For every i G Al^, it holds that 

*?rV['?) > ^f;\urpi%u:^i — i as n ^ oo. (3.24) 

We fix an / G N large enough to fulfill ^-^^ > 1 — | and use the ergodic 
decomposition ()3.20p to obtain the lower bound 

From (j3.24p we conclude that for n large enough 

(VFj^fl^ ) ^ ^^'"^ (^f? ) > 1 - ^- (3-26) 

We proceed by following the lines of [18] by introducing the sequence Im, 
m G N, where each Im is a power of 2 fulfilling the inequality 

Im^^'^"" <m< 2/^23-2''". (3.27) 

Let the integer sequence and the real- valued sequence Rm be defined by 
nm '■= Lf^J and Rm '■= Im.- + §)• Then we set 

p^{«™n„) ^ -,_®{m-/„n„) otherwise . 



Observe that 



llogTrQi™) < ^logTrQi-) 



4/m log(nm + 1) Rm I , , 

< ^ + -r^ + — (3.29) 

'"in IT-m '■m '^m 

4'" 6/„ + 2 e 1 , , 



where the second inequality is by estimate (13.190 and the last one by the 
bounds on Um 



2^im _i<!!l_x<^^<!!l< 26'm+i_ 
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Thus, for large m, it holds 

— logTv Q'if <s + e. (3.31) 

m 

By the special choice (I3.27P of Im it is ensured that the sequence of projec- 
tors Q^J^^ G A^"^^ is indeed typical for any quantum state ^ with entropy 
rate s(^) < s, compare [18j. This means that {Q^^^jmeN is a sequence of 
universal typical projectors at level s. □ 



Construction of the Decompression Algorithm 

We proceed by applying the latter result to universal typical subspaces for 
our proof of the upper bound. Let < e < 6/2 be an arbitrary real number 
such that r := s + e is rational, and let Qm ■= Q^s^ be the universal pro- 
jector sequence of Theorem 13.5.61 Recall that the projector sequence qm is 
independent of the choice of the ergodic state ^, as long as s{'^) < s. 

Because of (|3.14|) . for m large enough, there exists some unitary trans- 
formation U* that transforms the projector into a projector belonging to 

{TL^rnr'])^ thus transforming every one-dimensional projector q < qm into 
a qubit string q := U*qU of length £{q) = [mr] . 

As shown in [4J, a UQTM can implement every classical algorithm, and 
it can apply every unitary transformation U (when given an algorithm for 
the computation of U) on its tapes within any desired accuracy. We can 
thus feed q (plus some classical instructions including a subprogram for 
the computation of U) as input into the UQTM il. This UQTM starts by 
computing a classical description of the transformation U, and subsequently 
applies U to q, recovering the original projector q = UqU* on the output 
tape. 

Since U = U{qm) depends on ^ only through its entropy rate s{^), the 
subprogram that computes U does not have to be supplied with additional 
information on ^ and will thus have fixed length. 

We give a precise definition of a quantum decompression algorithm 21, 
which is, formally, a mapping (r is rational) 

2t : N X N X Q X W|o,i}* ^ ^{o,i}* ' 
(k, m,r,q) q = 2l(/c, m, r, q) . 

We require that 2t is a "short algorithm" in the sense of "short in descrip- 
tion", not short (fast) in running time or resource consumption. Indeed, the 
algorithm 21 is very slow and memory consuming, but this does not matter, 
since Kolmogorov complexity only cares about the description length of the 
program. 

The instructions defining the quantum algorithm 21 are: 
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1. Read the value of m, and find a solution / G N for the inequality 

/ • 2^' < m < 2 • / • 2^-2' 
such that / is a power of two. (There is only one such /.) 

2. Compute n := [f J . 

3. Read the value of r. Compute R := I ■ r. 

(n) 

4. Compute a list of codewords belonging to a classical universal 
block code sequence of rate R. (For the construction of an appropriate 
algorithm, see [20^ Thm. 2 and 1].) Since 

R = {uji,u>2, • • • , wm} can be stored as a list of binary strings. Ev- 
ery string has length £{uJi) = nl. (Note that the exact value of the 
cardinality M ~ 2""^ depends on the choice of ^^l^-) 

During the following steps, the quantum algorithm 21 will have to deal with 

• rational numbers, 

• square roots of rational numbers, 

• binary-digit-approximations (up to some specified accuracy) of real 
numbers, 

• (large) vectors and matrices containing such numbers. 

A classical TM can of course deal with all such objects (and so can a QTM): 
For example, rational numbers can be stored as a list of two integers (con- 
taining numerator and denominator), square roots can be stored as such 
a list and an additional bit denoting the square root, and binary-digit- 
approximations can be stored as binary strings. Vectors and matrices are 
arrays containing those objects. They are always assumed to be given in the 
computational basis. Operations on those objects, like addition or multipli- 
cation, are easily implemented. 

The quantum algorithm 21 continues as follows: 

5. Compute a basis of the symmetric subspace 

SYM"(^(')) := span{A®" : A £ A^^^} . 

This can be done as follows: For every n-tuple {ii, . . . , in}, where ik G 
{1,...,22'}, there is one basis element G A^'''^\ given by the 

formula 

= X]^c.(n,...,i„) ' (3.32) 



3.5. Quantum Brudno's Theorem 



87 



where the summation runs over all n-permutations a, and 




:= el' e^;^ ... e^; 



,(0 



with 



k=l 



a 



system of matrix unitcl in -^^^^ ■ 



There is a number of d = ("22^7^) = dim(SYM"(^('))) different 
matrices ^{ii, which we can label by {Afc}^^-^. It follows from 
(j3.32p that these matrices have integer entries. 

They are stored as a list of 2'" x 2'"-tables of integers. Thus, this step 
of the computation is exact, that is without approximations. 

6. For every i G {1, . . . , M} and k £ {1, . . . , d}, let 



where \oJi) denotes the computational basis vector which is a tensor 
product of |0)'s and |l)'s according to the bits of the string Wj. Com- 
pute the vectors \uk^i) one after the other. For every vector that has 
been computed, check if it can be written as a linear combination of 
already computed vectors. (The corresponding system of linear equa- 
tions can be solved exactly, since every vector is given as an array of 
integers.) If yes, then discard the new vector \uk^i), otherwise store it 
and give it a number. 

This way, a set of vectors {\uk)}j^^i is computed. These vectors linearly 
span the support of the projector wj^^^^ given in ()3.17p . 

7. Denote by {\4>i)}i=i the computational basis vectors of TCm-in- If 
m = I ■ 2^'\ then let D := D, and let \xk) := |ttfc). Otherwise, com- 
pute \uk) ® \(t)i) for every A: € {1, ...,£»} and i G {1, ... , 2"^-'"}. The 
resulting set of vectors {\xk)}^^i has cardinality D := D ■ 2™~^". 

In both cases, the resulting vectors \xk) G 'Hm will span the support 
of the projector qI^^ = qm- 

8. The set {\xk)}^^i is completed to linearly span the whole space Tim- 
This will be accomplished as follows: 

Consider the sequence of vectors 

(|xi), \X2),.. . , \Xf)_^_^m)) ■■= |X2), . . . , \Xf)), |^>i), 1^2), • • • , 1^2™)), 

where {^k}k=i denotes the computational basis vectors of Tim- Find 
the smallest i such that \xi) can be written as a linear combination of 

*In the computational basis, all entries are zero, except for one entry which is one. 



Uk,i) ■■= Ak\uJi) 



88 



Quantum Kolmogorov Complexity 



l^i)) 1^2)5 ••• ) l^i-i); and discard it (this can still be decided exactly, 
since all the vectors are given as tables of integers). Repeat this step D 
times until there remain only 2"* linearly independent vectors, namely 
all the \xj) and 2™ - Z) of the 

9. Apply the Gram-Schmidt orthonormalization procedure to the result- 
ing vectors, to get an orthonormal basis {\yk)}'k=i of Tim, such that 
the first D vectors are a basis for the support of Q^J^^ = q-m- 

Since every vector \xj) and has only integer entries, all the re- 
sulting vectors \yk) will have only entries that are (plus or minus) the 
square root of some rational number. 

Up to this point, every calculation was exact without any numerical 
error, comparable to the way that well-known computer algebra systems 
work. The goal of the next steps is to compute an approximate description 
of the desired unitary decompression map U and subsequently apply it to 
the quantum state q. 

According to Section 6 in [3], a UQTM is able to apply a unitary trans- 
formation U on some segment of its tape within an accuracy of 6, if it is 
supplied with a complex matrix U as input which is within operator norm 
distance 2(io^)ti ^ (here, d denotes the size of the matrix). Thus, the next 
task is to compute the number of digits that are necessary to guarantee 
that the output will be within trace distance 6 = ^ of q. 

10. Read the value of k (which denotes an approximation parameter; the 
larger k, the more accurate the output of the algorithm will be). Due 
to the considerations above and the calculations below, the necessary 
number of digits N turns out to be A = 1 [log(2fc2'"(10\/2™)2'")] . 
Compute this number. 

Afterwards, compute the components of all the vectors {\yk)}'k=i ^p 
to A binary digits of accuracy. (This involves only calculation of the 
square root of rational numbers, which can easily be done to any de- 
sired accuracy.) 

Call the resulting numerically approximated vectors \yk)- Write them 
as columns into an array (a matrix) U := {yi,y2, ■ ■ ■ , ?/2"')- 

Let U := (yi, 2/2, • • • J 2/2™) denote the unitary matrix with the exact 
vectors \yk) as columns. Since A" binary digits give an accuracy of 
2"^, it follows that 



2 • 2™(10V2™^)2'" 

If two 2™ X 2'"-matrices U and U are e-close in their entries, they also 
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must be 2*" • e-close in norm, so we get 



\U-U\\ < 



1/k 
2(10\/2™)2" 



So far, every step was purely classical and could have been done on a classical 
computer. Now, the quantum part begins: q will be touched for the first time. 

11. Compute [mr], which gives the length i{q). Afterwards, move q to 
some free space on the input tape, and append zeroes, i.e. create the 
state 

9' = lV'o)(^oh=(|0)(0|)^('"-^®)®g 
on some segment of m cells on the input tape. 

12. Approximately apply the unitary transformation U on the tape seg- 
ment that contains the state q' . 

The machine cannot apply U exactly (since it only knows an approx- 
imation U), and it also cannot apply U directly (since U is only ap- 
proximately unitary, and the machine can only do unitary transforma- 
tions). Instead, it will effectively apply another unitary transformation 
V which is close to U and thus close to U, such that 

\\V-U\\ < I . 

k 

Let := U\ipo) be the output that we want to have, and let |0) := 
yiV'o) be the approximation that is really computed by the machine. 
Then, 

lll'^>-|V')ll<^. 

A simple calculation proves that the trace distance must then also be 
small: 

|||<^)(<^|-|V^)(V^||b<^. 

14. Move q := to the output tape and halt. 



Proof of Proposition 13.5.51 

We have to give a precise definition how the parameters (m, r, q) are encoded 
into a single qubit string a. (According to the definition of QC, the param- 
eter k is not a part of a, but is given as a second parameter. See Definitions 
[2X71 and [3XT] for details.) 

We choose to encode m by giving [logmj I's, followed by one 0, followed 
by the [logmJ +1 binary digits of m. Let \M){M\ denote the corresponding 
projector in the computational basis. 
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The parameter r can be encoded in any way, since it does not depend on 
m. The only constraint is that the description must be self-dehmiting, i.e. it 
must be clear and decidable at what position the description for r starts and 
ends. The descriptions will also be given by a computational basis vector (or 
rather the corresponding projector) \R){R\. 

The descriptions are then stuck together, and the input cr(g) is given by 

aiq) := \M){M\ ® \R){R\^q . 

If m is large enough such that (j3.3ip is fulfilled, it follows that £{a{q)) = 
2 [log m\ + 2 + c + \mr~\ , where c G N is some constant which depends on r, 
but not on m. 

It is clear that this qubit string can be fed into the reference UQTM 
it together with a description of the algorithm 21 of fixed length c' which 
depends on r, but not on m. This will give a qubit string (Tix{q) of length 

^(<7ii(g)) = 2 [log m\ + 2 + C+ \mr] + c' 

< 2 log m + m + ^(5^ + c" , (3.33) 

where c" is again a constant which depends on r, but not on m. Recall 
the matrix U constructed in step 11 of our algorithm 21, which rotates 
(decompresses) a compressed (short) qubit string q back into the typical 
subspace. Conversely, for every one-dimensional projector q < qm, where 
Qm = Qs^^ was defined in ()3.28p . let q G 'H^mr] be the projector given by 
{\0){0\ f("'-^"'^^)^q=U*qU. Then, since 21 has been constructed such that 

\\ii{k, aixiq)) - Q\Wr < ^ for every A: G N , 
it follows from (13.330 that 

— QC{q) < 2^- + S + -6+— . 
m m 2 m 

If m is large enough. Equation (j3.12p follows. 

Now we continue by proving Equation ()3.13p . Let k := [^1. Then, we 
have for every one-dimensional projector q < qm and m large enough 

^QC''{q) < IgcV'^(g) < IqcM + ^^i^^^ 

m m m m 

< s + 6+^-^^^^^<s + 26, (3.34) 
m 

where the first inequality follows from the obvious monotonicity property 
6 > e ^ < QC^ the second one is by Lemma 13.1.21 and the third 

estimate is due to Equation (j3.12p . □ 
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Proof of the Main Theorem 13.5.11 Let qm{S) be the ^f-typical projector 
sequence given in Proposition 13.5.5] i.e. the complexities :^QC and ^QC^ 
of every one-dimensional projector q < qm{6) are upper bounded by s + (5. 
Due to Corollary 13.5.31 there exists another sequence of ^'-typical projec- 
tors PmiS) < qm{S) such that additionally, ^QC^{q) > s — 5{A + 6)s is 
satisfied for q < Pmi^)- From Corollary 13.5.41 we can further deduce that 
there is another sequence of \I'-typical projectors qmi^) < Pm{S) such that 
also ^QC{q) > s — S holds. Finally, the optimality assertion is a direct 
consequence of Lemma 13.2. H combined with Theorem 13.5.21 □ 
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Chapter 4 

Summary and Outlook 

In this thesis, we have formally defined quantum Kolmogorov complexity, 
based on work by Berthiaume et al. and have given rigorous mathe- 
matical proofs of its basic properties. In particular, we have shown that 
the quantum Kolmogorov complexity notions QC and QC^ are invariant, 
that they coincide with classical complexity for classical strings, they have 
incompressibility properties, and the corresponding quantum Kolmogorov 
complexity rates agree with the von Neumann entropy rate for ergodic quan- 
tum information sources. 

The most complicated step to achieve these results was to give a rigorous 
formal proof that there exists a universal quantum Turing machine (QTM) 
il in the following sense: that QTM 11 can simulate every other QTM for 
an arbitrary number of time steps, without knowing the running time in 
advance, and then halt itself with probability one. The question whether 
this is possible has been ignored in previous work on quantum Kolmogorov 
complexity, but it is necessary to prove the invariance property, i.e. the 
feature that quantum Kolmogorov complexity depends on the choice of the 
universal quantum computer only up to an additive constant. 

We also discussed the question how the halting of a QTM can be defined. 
We argued that for the purpose of studying quantum Kolmogorov complexi- 
ty, the most useful and natural definition is to demand perfect halting. To 
show that this definition is not as restrictive as one might first suppose, 
we proved that every input that makes a QTM halt approximately can be 
enhanced by at most a constant number of qubits to make the universal 
QTM halt entirely. 

Furthermore, we have defined the average-length complexities QK and 
QK and studied them to some extent. Because of Lemma 13.3.41 and the 
proof idea of Conjecture 12.2.31 we think that these complexities are closely 
related to prefix QTMs, which we have defined in Definition 12.3.51 Study- 
ing prefix QTMs may also be interesting for another reason: it may give 
an alternative approach to Tadaki's definition [H] of the quantum halting 
probability, and it may help to clarify the relation of the complexity notions 
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QK or QK to the universal density matrix approach by Gacs. This specu- 
lation is supported by the fact that classical prefix complexity is related to 
universal probability and Chaitin's halting probability by Levin's theorem 

m- 

Classical Kolmogorov complexity has a large variety of applications in 
different fields of mathematics and computer science. Hence it may be worth- 
while to look for applications of quantum Kolmogorov complexity. A very 
promising field for application is quantum statistical mechanics, since clas- 
sical Kolmogorov complexity has already turned out to be useful in the 
classical version of that theory. 

A concrete proposal for an application of quantum Kolmogorov complex- 
ity is to analyze a quantum version of the thought experiment of Maxwell's 
demon. In one of the versions of this thought experiment, some microscopic 
device tries to decrease the entropy of some gas in a box, without the expense 
of energy, by intelligently opening or closing some little door that separates 
both halves of the box. 

It is clear that a device like this cannot work as described, since its 
existence would violate the second law of thermodynamics. But then, the 
question is what prevents such a little device (or "demon") from operating. 
Roughly, the answer is that the demon has to make observations to de- 
cide whether to close or open the door, and these observations accumulate 
information. From time to time, the demon must erase this additional infor- 
mation, which is only possible at the expense of energy, due to Landauer's 
principle. 

In ^23j , this cost of energy is analyzed under very weak assumptions with 
the help of Kolmogorov complexity. Basically, the energy that the demon can 
extract from the gas is limited by the difference of the entropy of the gas, plus 
the difference of the Kolmogorov complexity of the demon's memory before 
and after the demon's actions. The power of this analysis is that it even 
encloses the case that the demon has a computer to do clever calculations, 
e.g. to compress the accumulated information before erasing it. 

It seems that quantum Kolmogorov complexity might have all the prop- 
erties needed to extend this analysis to the quantum case. Yet, the average- 
length complexities QK or QK are probably more useful in this case than 
QC or QC^ , since they resemble more closely the fact that the expecta- 
tion value of the amount of information that has to be erased is physically 
important, not the maximal size of the system. 

To conclude, we found that quantum Kolmogorov complexity is a beau- 
tiful concept with a promising potential for new applications. Applications 
aside, quantum Kolmogorov complexity offers the opportunity to deepen 
our understanding of the theoretical aspects of quantum computation and 
is interesting as a subject in its own right. 
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The following lemma is due M. B. Ruskai ([38j) and can also be found in 
|30j for the finite-dimensional case. 



Lemma A.l (Quantum Operations are Contractive) 

Let 7i and 7i' be Hilbert spaces, and let E : T{7i) T{7i') he linear, positive 
and trace-preserving. If A = A* G TiTi), then 

\\£{A)U < PIlTr. 



Proof. If P > is any positive trace-class operator on 7i, then 

IIPIIti. = -TrlPl = -TrP. 
II lllr 2 ' ' 2 

Since every self-adjoint operator A can be written as ^ = A^ — A-, where 
and A- are positive operators, we get 

mA)\\Tr = ||£:(^+-^„)||Tr<||^:(^+)||Tr + ||f(^-)||Tr 

= ^Tt£{A+) + ^Tt£{A.) = ^TtA+ + ^TrA_ 

= ^TV(A+ + A_) = ^Tr|A| = PIlTr. □ 



Lemma A. 2 (Inner Product and Dimension Bound) 

Let TL he a Hilbert space, and let iV'i), ■ ■ ■ , \iPn) G W with \\ \'tpi)\\ = 1 for 
every i G {1, . . . , N}, where 2 < N £ N. Suppose that 

Then, dim'H > N. In particular, the vectors ^'"e linearly indepen- 

dent. 
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Proof. We prove the statement by induction in N E N. For N = 2, 
the statement of the theorem is trivial. Suppose the claim holds for some 

N > 2, then consider + 1 vectors iV'i), ■ ■ ■ , |^7V+i) £ 'H, where TC is an 
arbitrary Hilbert space. Suppose that < for every i / j. Let 

P := 1 — |'07v+i)(V'Af+i|) then P\ipi) / for every i G {1, . . . ,N}, and let 



1^^)11 ■ 

The \ipi) are normalized vectors in the Hilbert subspace H := ran(P) of Ti. 
Since || \ip'^)\\'^ = — \{i^i\ipN+i)\'^ > 1 — it follows that the vectors 

\ipi) have small inner product: Let i ^ j, then 

< I ^ r l(V'#j) - (V'iV+l|V'j)(V'i|^iV+l)| 



< 



1/1 1 \ 1 



I - \N N"^ ) iV-1 



Thus, dimT^ > N, and so dim 7^ > AT + 1. □ 



Lemma A. 3 (Composition of Unitary Operations) 

LetH be a finite- dimensional Hilbert space, let (Vi)igpj be a sequence of linear 
subspaces ofH (which have all the same dimension), and let Ui : Vi ^ V^+i 
be a sequence of unitary operators on H such that Y^^=i \Wk ~ 1|| exists. 
Then, the product HfcLi = . . . ■ U3 ■ U2 ■ Ui converges in operator norm to 
an isometry U : Vi ^ H. 



Proof. We first show bv induction that 



ULiUk-i <ELi\\u> 



1||. This is trivially true for A'" = 1; suppose it is true for N factors, then 



N+l 
k=l 



< 



< 



N+l 



N 



llUk-l[Uk 

k=l k=l 

N 

(c/jv+1 - 1) n 



+ 



N 



k=l 



k=l 

N N+l 

Y.\\Uk-i\\<j2\\Uk-i\ 



k=l 



k=l 



By assumption, the sequence a„ := X]fc=i II ^fc ~ ^11 ^ Cauchy sequence; 
hence, for every e > there is an A^^ G N such that for every L, N > it 
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holds that J2k=L+i \\^k — M\ < £• Consider now the sequence Vn := 11^=1 ^k- 
If N>L>Ne, then 



II^tv-^lI 



N L L 

n Uk-iiUk-iiUk 

k=L+l k=l 



k=l 



< 



N 



n 



k=L+l 



k=l 



N 



< \\Uk-l\\<e 



k=L+l 



SO {Vn)n(^N IS also a Cauchy sequence and converges in operator norm to some 
linear operator U on 14. It is easily checked that U must be isometric. □ 



Lemma A. 4 (Norm Inequalities) Let Ti. be a finite- dimensional Hilbert 
space, and let \ip), \ip) G 7i with \\ \ip)\\ = \\ \ip)\\ = 1. Then, 

llTr < II IV')- 1^)11 ■ 

Moreover, if p,a & T^{7i) are density operators, then 

\\p - cr\\ < \\p - crllTr ■ 



Proof. Let A := |V')(V'| - \ip){ip\. Using [30, 9.99], 
|A||2, = 1-|(V-|^)|2 = (1-KV^|(^)|) (1 + 1(^1^)1) 

^ V ' 

<2 

< 2-2m^)\<2-2Re{i^\cp) = {ip-ip\ip-cp) = \\\^P) - \ip)\ 



2 



Let now A := p — a, then A is Hermitian. We may assume that one 
of its eigenvalues which has largest absolute value is positive (otherwise 
interchange p and a), thus 

||A|| = max (t>|A|f) = max Tr(PA) < max Tr(PA) = ||A||Tr 
II k>ll=i P proj., TrP=i P proj. 

according to [30, 9.22]. □ 



Lemma A. 5 (Dimension Bound for Similar Subspaces) 

Let TC be a finite- dimensional Hilbert space, and let V,W C TC be subspaces 
such that for every \v) G V with \\ \v)\\ = 1 there is a vector \w) G W with 
II \w)\\ = 1 which satisfies \\ \v) — \w)\\ < e, where < e < 4(dimV-i)^ is fixed. 
Then, dimW > dim^. Moreover, if additionally e < ^ (|)^ 2dimy ^^^^^ 
then there exists an isometry U : V ^ W such that \\U — < f-v/e (f )'^™^- 
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Proof. Let {|fi), . . . , \ vd)} be an orthonormal basis of V. By assumption, 
there are normalized vectors {|u>i), . . . , \wd)} C W with || \vi) — \wi)\\ < e 
for every i. From the definition of the trace distance for pure states (see \30\ 
(9.99)] together with Lemma lA.41 it follows for every i ^ j 



^Jl- \ {wi\wj)\'^ = \\\wi){wi\-\wj){wj\\\T:^ 

> II bi)(^j| - Wtt - II \Vi){Vi\ - \Wi){Wi\ llxr 

-|| l^i)(^'jl - \ IItt 

> 1 - II \Vi) - \Wi)\\ - II \Vj) - \Wj)\\ 

> 1 - 2e . 



Thus, |(t(;j|?Uj)| < 2^/e < ^j^, and it follows from Lemma IA.2I that 
dimVF > d. Now apply the Gram-Schmidt orthonormalization procedure 
to the vectors {\wi)}f^i: 



k-l 



Ih) ■= \wk) - y^^{wk\ei)\ei 



\ek) 



i=l 



\ek) 
\\\ek)\\ 



Use 



III |eA:)|| - II \wk)\\ \ < II |efc) - \wk)\\ and calculate 



\\\ek)-\wk)\\ 



k-l 

E 



{wk\ei)\ei 



i=l 
k-l ,, 



< 



k-l 

E 



\{wk\ei - Wi)\ + \{wk\wi)\ 



i=l 

< X ■ „ - \wi)\\ +2Ve 
1=1 



ET 



Let Afc := || |efc) — |u^fc)|| for every 1 < k < d. We will now show by induction 
that Afc < 2^/e 



2 f5\'' 



5 V2y 



1 



. This is trivially true for k = 1, since Ai = 0. 

Suppose it is true for every 1 < i < A; — 1, then in particular, Aj < ^ by the 
assumptions on e given in the statement of this lemma, and 



A. <- E^^Ef^v/^ 



i=l 



Thus, it holds that 



2 /5 



2 /5 
5 \2 



+ 2Vi 



5 V2 



|efc>-|^;fc)|| < \\Vk)-\ek)\\^\\\ek)-\wk)\\^\\\wk)-\vk)\\ 

, ^ ^k 

< 2\\\ek) - \wk)\\ + e < ' ' ' ^ ^ 



2 /5 
5 V2 



1 
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Now define the linear operator U : V ^ W via linear extension of U\vi) := 
\ei) for 1 < i < d. This map is an isometry, since it maps an orthonormal 
basis onto an orthonormal basis of same dimension. By substituting \v) = 
Ylk=i^k\'Vk) and using e < 4-^ and the geometric series, it easily follows 
that \\U\v)-\v)\\ <l^{^y if\\\v)\\ = l. □ 



Lemma A. 6 (Stability of the Control State) 

// \ip), \ip), \v) £ Tin and \\ \ip)\\ = \\ |(/?)|| = 1 and \v) / 0, then it holds for 
every QTM M and every t S No 

|(g/|M*,(|^)(^|)|g^)-(g^|M*,(|(^)((^|)|g/)| < 
\{qf\M'c{\v){v\)\qf)-{qf\Mh{\v'){v''\)\qf)\ < |l - || 1^)1^ . 



Proof. Using the Cauchy-Schwarz inequality, Lemma IA.4I and the 
contractivity of quantum operations with respect to the trace distance 
(Lemma lA.ip . we get the chain of inequalities 

At := |(g;|M*,(|V')(Vl)k/>-(g/|M*,(|(^)(y.|)|g^)| 

< ||M*,(|V^)(V'|)-M*,(|(^)(v9|)|| 

< ||M*,(|V')(V|)-M*,(|(^)((/,|)||^ 

The second inequality can be proved by an analogous calculation. □ 
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Glossary of Symbols and 
Notation 



Notation 


Meaning 


Page 




■j- n £i Gti'l' r\\ \\ cw iTiHti/H iTiticiT' rw\(^'Wi\ itpg f\x\ cr^Tn H i i\ t^T*"!" 
lilt; oC t UL* U-liLicU. illlcdl U Uci dLUl a Lfli oUlliC XXliUCi U 

space W 






f 1 if t = T 

the Kronecker symbol: btT \ n -f ^ / t-i' 

1 U 11 Z- . 


ESI 


dom M 


the domain of definition of the map (e.g. QTM) M 


m 


"^{0,1}* 


Lilt; L[U.Ult oUillig, llliUci \i ojJcHjC vi/?T,pMn ^ 


nrn 

[XUj 




the halting space of the Q i M M for time t and inputs 
of length n 


lo 1 1 

1311 




the approximate halting space of accuracy e of the 
QTM M for time t and inputs of length n 


M 




Tin = (C^)*^" with some fixed computational basis 


m 


^(•) 


the length of some classical finite binary string, or the 
base length of some qubit string 


m 




the average length of some qubit string p, given by 
Tr(Ap), where A is the length operator 


M 




the state of the control of the QTM M at time t, if 
the input was the qubit string a 


ESI 




the state of the output tape of the QTM M at time t, 
if the input was the qubit string a 




QTM 


quantum Turing machine 


m 


7^ 


"Reading operation": if a is the state of a QTM's out- 
put tape, then TZ{(7) is the corresponding qubit string. 




ran U 


the range of some map U 


SSI 


al 


the restriction of the qubit string a to its first n qubits 


El 




the set of trace-class operators on a Hilbert space 7i 


m 




the set of density operators, i.e. positive trace-class 
operators of trace 1, on some Hilbert space Ti. 


uni 


TM 


Turing machine 


m 


Tr(A) 


the trace of the operator A, if A is a trace-class oper- 
ator on some Hilbert space 


m 


Trc(p) 


the partial trace over the part C of the whole Hilbert 
space (normally, C denotes a QTM's control) 
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